2020-07-16T20:19:51.390 INFO:root:teuthology version: 1.0.0-10de4c5 2020-07-16T20:19:51.393 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi --verbose --archive /home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371 --description fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_trivial_sync} --block --lock --owner scheduled_pdonnell@teuthology -- /tmp/teuthology-worker.e35o1cer.tmp 2020-07-16T20:19:51.429 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:19:51.502 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371 branch: wip-pdonnell-testing-20200716.140830 description: fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_trivial_sync} email: pdonnell@redhat.com first_in_suite: false job_id: '5231371' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200716.140830 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd_max_omap_entries_per_request: 10 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200716.140830 sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a owner: scheduled_pdonnell@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20200716.140830 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.20771 2020-07-16T20:19:51.503 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa; will attempt to use it 2020-07-16T20:19:51.504 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks 2020-07-16T20:19:51.504 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-07-16T20:19:51.506 INFO:teuthology.task.internal:Checking packages... 2020-07-16T20:19:51.530 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a' 2020-07-16T20:19:51.530 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-16T20:19:51.531 INFO:teuthology.packaging:ref: None 2020-07-16T20:19:51.531 INFO:teuthology.packaging:tag: None 2020-07-16T20:19:51.532 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200716.140830 2020-07-16T20:19:51.532 INFO:teuthology.packaging:sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:19:51.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200716.140830 2020-07-16T20:19:51.715 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-3565.g8e60ca350a5 2020-07-16T20:19:51.716 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-07-16T20:19:51.726 INFO:teuthology.task.internal:no buildpackages task found 2020-07-16T20:19:51.726 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-07-16T20:19:51.748 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-07-16T20:19:51.748 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:19:51.809 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-16T20:20:01.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-07-16T20:20:11.853 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371'} 2020-07-16T20:20:11.886 DEBUG:teuthology.lock.ops:locked ubuntu@smithi157.front.sepia.ceph.com, ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:20:11.997 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8b31c7ce18>, signals=[15]) 2020-07-16T20:20:12.216 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of centos 8.1 2020-07-16T20:20:12.221 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.1 2020-07-16T20:20:12.581 INFO:teuthology.orchestra.console:Power off smithi157 2020-07-16T20:20:12.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T20:20:12.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:12.647 INFO:teuthology.orchestra.console:Power off smithi041 2020-07-16T20:20:12.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T20:20:12.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:12.770 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2020-07-16T20:20:12.820 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2020-07-16T20:20:12.872 INFO:teuthology.orchestra.console:Power on smithi157 2020-07-16T20:20:12.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T20:20:12.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:12.934 INFO:teuthology.orchestra.console:Power on smithi041 2020-07-16T20:20:12.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T20:20:12.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:16.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:17.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:17.194 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2020-07-16T20:20:17.299 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2020-07-16T20:20:21.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:21.345 INFO:teuthology.orchestra.console:Power on for smithi041 completed 2020-07-16T20:20:21.447 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish 2020-07-16T20:22:37.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:22:46.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:22:55.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:03.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:04.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:12.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:13.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:21.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:22.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:30.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:39.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:48.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:58.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:07.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:28.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:29.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T20:24:29.130 INFO:teuthology.orchestra.run.smithi041:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T20:24:29.461 INFO:teuthology.provision.fog.smithi041:Node is ready 2020-07-16T20:24:29.462 INFO:teuthology.orchestra.run.smithi041:> hostname 2020-07-16T20:24:29.477 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com 2020-07-16T20:24:29.478 INFO:teuthology.orchestra.run.smithi041:> grep smithi041.front.sepia.ceph.com /etc/hosts 2020-07-16T20:24:29.533 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041 2020-07-16T20:24:29.534 INFO:teuthology.orchestra.run.smithi041:> sudo hostname smithi041 2020-07-16T20:24:29.642 INFO:teuthology.orchestra.run.smithi041:> sudo sed -i -e 's/smithi041.front.sepia.ceph.com/smithi041/g' /etc/hosts 2020-07-16T20:24:29.676 INFO:teuthology.orchestra.run.smithi041:> sudo sed -i -e 's/172.21.15.41/172.21.15.41/g' /etc/hosts 2020-07-16T20:24:29.747 INFO:teuthology.orchestra.run.smithi041:> sudo sed -i -e 's/smithi041.front.sepia.ceph.com/smithi041/g' /etc/hostname 2020-07-16T20:24:29.821 INFO:teuthology.orchestra.run.smithi041:> sudo hostname smithi041 2020-07-16T20:24:29.891 INFO:teuthology.provision.fog.smithi041:Deploy complete! 2020-07-16T20:24:29.893 DEBUG:teuthology.parallel:result is None 2020-07-16T20:25:13.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:25:13.400 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T20:25:13.400 INFO:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T20:25:13.728 INFO:teuthology.provision.fog.smithi157:Node is ready 2020-07-16T20:25:13.729 INFO:teuthology.orchestra.run.smithi157:> hostname 2020-07-16T20:25:13.752 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2020-07-16T20:25:13.752 INFO:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2020-07-16T20:25:13.813 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2020-07-16T20:25:13.813 INFO:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2020-07-16T20:25:13.924 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2020-07-16T20:25:13.959 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2020-07-16T20:25:14.027 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2020-07-16T20:25:14.094 INFO:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2020-07-16T20:25:14.167 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2020-07-16T20:25:14.168 DEBUG:teuthology.parallel:result is None 2020-07-16T20:25:14.323 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2020-07-16T20:25:14.324 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T20:25:14.347 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com 2020-07-16T20:25:14.348 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T20:25:14.370 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2020-07-16T20:25:14.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:25:14.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:25:14.443 INFO:teuthology.orchestra.run.smithi157:> true 2020-07-16T20:25:14.600 INFO:teuthology.orchestra.run.smithi157:> uname -m 2020-07-16T20:25:14.653 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2020-07-16T20:25:14.654 INFO:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2020-07-16T20:25:14.707 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Linux" 2020-07-16T20:25:14.708 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8 (Core)" 2020-07-16T20:25:14.708 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2020-07-16T20:25:14.709 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:25:14.709 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2020-07-16T20:25:14.709 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:25:14.710 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:25:14.710 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2020-07-16T20:25:14.710 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:25:14.711 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:25:14.711 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:25:14.711 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:25:14.712 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:25:14.712 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:25:14.712 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:25:14.713 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:25:14.713 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:25:14.715 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2020-07-16T20:25:14.739 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server 2020-07-16T20:25:14.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:25:14.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:25:14.818 INFO:teuthology.orchestra.run.smithi041:> true 2020-07-16T20:25:15.001 INFO:teuthology.orchestra.run.smithi041:> uname -m 2020-07-16T20:25:15.056 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2020-07-16T20:25:15.057 INFO:teuthology.orchestra.run.smithi041:> cat /etc/os-release 2020-07-16T20:25:15.111 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="CentOS Linux" 2020-07-16T20:25:15.112 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="8 (Core)" 2020-07-16T20:25:15.113 INFO:teuthology.orchestra.run.smithi041.stdout:ID="centos" 2020-07-16T20:25:15.113 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:25:15.113 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="8" 2020-07-16T20:25:15.114 INFO:teuthology.orchestra.run.smithi041.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:25:15.114 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:25:15.114 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31" 2020-07-16T20:25:15.114 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:25:15.115 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:25:15.115 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:25:15.115 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:25:15.116 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:25:15.116 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:25:15.116 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:25:15.117 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:25:15.117 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:25:15.118 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2020-07-16T20:25:15.154 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-07-16T20:25:15.194 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKeLp5LDrmfDONyEG2atDEsZrwyOHe1xa1YI35axqfJPMD31zQHyzdnZlTE+4YDryg5Ym9KQCOeZXvZTfzsGPR6ajkJCefs1Z1fXYeZrSiRWbQ7RAYs6CsRiqbc2VZcUnRjSz4b+nFwtEgy+bt/NhBbXZGKohd88u9y3pBVmFk+Db+LvihJN/GOGSq47lZ/0NFd8tnHhaEXAUEEWqXyjaDlHFbSZ+IQAyA5q8bovw8TPlHwkDp+NkWze22TaduGy3nBpsTR6NK20CttvbL/XMZhk5NwNt9B/AZwWTzBa7bacOuf8FpN9i8iw79bH01XT0Qcdtg1ZCun3sb6bDSIozQ0O5bM/D95Y07LGKWNVZWOBCljlbrvCwl/qyUIYIU6tfpvbebIrp5Q55tSRM54G07rF9z9+tm2d/fkT25I1k++EOwdMTe2iAHoNAMemO8/F0yTtDlox/FR8o5bFWqv3sQuYi5pTVWZ/yeAA9xF58pqj/h7kHEH55uom2S4BVYTbM= smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgyVhiCUHkw9TAx5ul6bEDUi5feEmqS//plU7UK94mbvrFdi1tdaI6Dxfq+ee4WNSpF11wWxEzO0hD2zPp6mjUKbsrb5HfvA817CwFys8JIXZF1gmWoX1QWq24b07WW2LXccM9pgxy7UsIRy7dD/BLIxxSOfmOVM8coui5+/bDhidOgUfq6AWEHKap9fPXle3Gw+F5bobGdaPeXe72ToB4Jr+6ytGfY0OJG0TV8JhhxNPQu8tW6p+cueGJ2IwOBXTovmpWSsSpowmSpLbeWPXV+keRC8UNNQbDCj0uVxpnHwGD+hxMV6dhYt2zSA2vSDnktjpq6OWMZGCIXvQNP3DPpOGqv3HHjPDktQ1L8HeoeT8F6pXnlfuIj5h/vjKNkSnI1233XxhxUb339G3TE4APQP9ATcPTLBWfPynpl73ZGCbQ3J+BPfUGgnbjd4g3du1lsx0kuTgGd36aNdVk2OR1rgwCfR0OAMkLdu587PIRWaHefVel3BPaBhG9FN5AZtk= 2020-07-16T20:25:15.195 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:25:15.267 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-07-16T20:25:15.276 INFO:teuthology.task.internal:Saving configuration 2020-07-16T20:25:15.310 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-07-16T20:25:15.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-07-16T20:25:15.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 20:20:11.861416', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD76z6nDd+O8l7X8IYLIo7NOQTMe/ltW3htirCcJ7/+moOoSwLbeqethMe2CEUwhQIQmCzW1nZxWbtnnIbDgtpA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi157.front.sepia.ceph.com'} 2020-07-16T20:25:15.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 20:20:11.861435', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiq5FBIeDKuMYIUELsWRfJx2gUg3bYZHqcNr7Z1x4IYwKNoh1m916k+oUM+DthmI16+mTGJSSuWFd9an2iZcJw=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi041.front.sepia.ceph.com'} 2020-07-16T20:25:15.552 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-07-16T20:25:15.564 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-07-16T20:25:15.565 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-07-16T20:25:15.565 INFO:teuthology.run_tasks:Running task console_log... 2020-07-16T20:25:15.732 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8b35f3fd08>, signals=[15]) 2020-07-16T20:25:15.735 INFO:teuthology.run_tasks:Running task internal.connect... 2020-07-16T20:25:15.745 INFO:teuthology.task.internal:Opening connections... 2020-07-16T20:25:15.746 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:25:15.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:25:15.830 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:25:15.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:25:15.949 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-07-16T20:25:15.959 INFO:teuthology.orchestra.run.smithi157:> uname -m 2020-07-16T20:25:15.975 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2020-07-16T20:25:15.976 INFO:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2020-07-16T20:25:16.030 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Linux" 2020-07-16T20:25:16.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8 (Core)" 2020-07-16T20:25:16.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2020-07-16T20:25:16.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:25:16.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2020-07-16T20:25:16.032 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:25:16.032 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:25:16.032 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2020-07-16T20:25:16.032 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:25:16.032 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:25:16.033 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:25:16.033 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:25:16.033 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:25:16.033 INFO:teuthology.orchestra.run.smithi157.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:25:16.034 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:25:16.034 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:25:16.034 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:25:16.035 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2020-07-16T20:25:16.079 INFO:teuthology.orchestra.run.smithi041:> uname -m 2020-07-16T20:25:16.101 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2020-07-16T20:25:16.102 INFO:teuthology.orchestra.run.smithi041:> cat /etc/os-release 2020-07-16T20:25:16.155 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="CentOS Linux" 2020-07-16T20:25:16.156 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="8 (Core)" 2020-07-16T20:25:16.156 INFO:teuthology.orchestra.run.smithi041.stdout:ID="centos" 2020-07-16T20:25:16.156 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:25:16.157 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="8" 2020-07-16T20:25:16.157 INFO:teuthology.orchestra.run.smithi041.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:25:16.157 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:25:16.157 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31" 2020-07-16T20:25:16.157 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:25:16.158 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:25:16.158 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:25:16.158 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:25:16.158 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:25:16.159 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:25:16.159 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:25:16.159 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:25:16.159 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:25:16.160 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2020-07-16T20:25:16.183 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-07-16T20:25:16.234 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-07-16T20:25:16.245 INFO:teuthology.task.internal:Checking for old test directory... 2020-07-16T20:25:16.246 INFO:teuthology.orchestra.run.smithi041:> test '!' -e /home/ubuntu/cephtest 2020-07-16T20:25:16.250 INFO:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2020-07-16T20:25:16.265 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-07-16T20:25:16.287 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-07-16T20:25:16.288 INFO:teuthology.orchestra.run.smithi041:> test -z $(ls -A /var/lib/ceph) 2020-07-16T20:25:16.306 INFO:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2020-07-16T20:25:16.329 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-07-16T20:25:16.399 INFO:teuthology.run_tasks:Running task kernel... 2020-07-16T20:25:16.429 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}} 2020-07-16T20:25:16.430 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-07-16T20:25:16.431 INFO:teuthology.orchestra.run.smithi157:> uname -r 2020-07-16T20:25:16.447 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:16.448 INFO:teuthology.task.kernel:Running kernel on smithi157: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:16.448 INFO:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2020-07-16T20:25:18.959 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - AppStream 39 MB/s | 7.0 MB 00:00 2020-07-16T20:25:20.158 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:25:20.591 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-07-16T20:25:21.012 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 20 MB/s | 7.4 MB 00:00 2020-07-16T20:25:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 4.3 MB/s | 20 kB 00:00 2020-07-16T20:25:23.463 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T20:25:23.463 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-07-16T20:25:23.608 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-07-16T20:25:23.609 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-07-16T20:25:23.609 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-07-16T20:25:23.708 INFO:teuthology.orchestra.run.smithi157:> echo no | sudo yum reinstall kernel || true 2020-07-16T20:25:24.108 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 08:25:22 PM UTC. 2020-07-16T20:25:24.378 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:24.379 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:24.420 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:24.466 INFO:teuthology.orchestra.run.smithi157:> sudo yum reinstall -y kernel || true 2020-07-16T20:25:24.870 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 08:25:22 PM UTC. 2020-07-16T20:25:25.142 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:25.143 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:25.169 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:25.216 INFO:teuthology.orchestra.run.smithi157:> rpm -q kernel --last | head -n 1 2020-07-16T20:25:25.279 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Thu 16 Jul 2020 06:30:18 PM UTC 2020-07-16T20:25:25.281 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:25.282 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T20:25:25.282 INFO:teuthology.orchestra.run.smithi041:> uname -r 2020-07-16T20:25:25.300 INFO:teuthology.orchestra.run.smithi041.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:25.300 INFO:teuthology.task.kernel:Running kernel on smithi041: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:25.300 INFO:teuthology.orchestra.run.smithi041:> sudo yum install -y kernel 2020-07-16T20:25:27.896 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - AppStream 38 MB/s | 7.0 MB 00:00 2020-07-16T20:25:29.161 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-07-16T20:25:29.611 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-07-16T20:25:30.038 INFO:teuthology.orchestra.run.smithi041.stdout:Extra Packages for Enterprise Linux 20 MB/s | 7.4 MB 00:00 2020-07-16T20:25:31.649 INFO:teuthology.orchestra.run.smithi041.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-07-16T20:25:32.607 INFO:teuthology.orchestra.run.smithi041.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T20:25:32.608 INFO:teuthology.orchestra.run.smithi041.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-07-16T20:25:32.760 INFO:teuthology.orchestra.run.smithi041.stdout:Dependencies resolved. 2020-07-16T20:25:32.762 INFO:teuthology.orchestra.run.smithi041.stdout:Nothing to do. 2020-07-16T20:25:32.762 INFO:teuthology.orchestra.run.smithi041.stdout:Complete! 2020-07-16T20:25:32.862 INFO:teuthology.orchestra.run.smithi041:> echo no | sudo yum reinstall kernel || true 2020-07-16T20:25:33.303 INFO:teuthology.orchestra.run.smithi041.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 08:25:31 PM UTC. 2020-07-16T20:25:33.597 INFO:teuthology.orchestra.run.smithi041.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:33.597 INFO:teuthology.orchestra.run.smithi041.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:33.685 INFO:teuthology.orchestra.run.smithi041:> sudo yum reinstall -y kernel || true 2020-07-16T20:25:34.112 INFO:teuthology.orchestra.run.smithi041.stdout:Last metadata expiration check: 0:00:03 ago on Thu 16 Jul 2020 08:25:31 PM UTC. 2020-07-16T20:25:34.372 INFO:teuthology.orchestra.run.smithi041.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:34.372 INFO:teuthology.orchestra.run.smithi041.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:34.405 INFO:teuthology.orchestra.run.smithi041.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:34.451 INFO:teuthology.orchestra.run.smithi041:> rpm -q kernel --last | head -n 1 2020-07-16T20:25:34.517 INFO:teuthology.orchestra.run.smithi041.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Thu 16 Jul 2020 06:30:18 PM UTC 2020-07-16T20:25:34.518 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:34.519 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T20:25:34.519 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-07-16T20:25:34.519 INFO:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T20:25:34.561 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2020-07-16T20:25:34.576 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-07-16T20:25:34.577 INFO:teuthology.orchestra.run.smithi041:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T20:25:34.618 INFO:teuthology.orchestra.run.smithi041.stdout:ttyS1 2020-07-16T20:25:34.629 INFO:teuthology.run_tasks:Running task internal.base... 2020-07-16T20:25:34.638 INFO:teuthology.task.internal:Creating test directory... 2020-07-16T20:25:34.639 INFO:teuthology.orchestra.run.smithi041:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T20:25:34.671 INFO:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T20:25:34.688 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-07-16T20:25:34.699 INFO:teuthology.run_tasks:Running task internal.archive... 2020-07-16T20:25:34.717 INFO:teuthology.task.internal:Creating archive directory... 2020-07-16T20:25:34.718 INFO:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T20:25:34.726 INFO:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T20:25:34.758 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-07-16T20:25:34.769 INFO:teuthology.task.internal:Enabling coredump saving... 2020-07-16T20:25:34.770 INFO:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T20:25:34.786 INFO:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T20:25:34.821 INFO:teuthology.orchestra.run.smithi041.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:34.833 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:34.838 INFO:teuthology.orchestra.run.smithi041.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:34.847 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:34.849 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-07-16T20:25:34.864 INFO:teuthology.task.internal:Configuring sudo... 2020-07-16T20:25:34.864 INFO:teuthology.orchestra.run.smithi041:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T20:25:34.882 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T20:25:34.918 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-07-16T20:25:34.931 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-07-16T20:25:34.931 INFO:teuthology.orchestra.run.smithi041:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T20:25:34.953 INFO:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T20:25:34.978 INFO:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:35.064 INFO:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:35.131 INFO:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:35.168 INFO:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:35.226 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T20:25:35.341 INFO:teuthology.orchestra.run.smithi041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:35.381 INFO:teuthology.orchestra.run.smithi041:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:35.442 INFO:teuthology.orchestra.run.smithi041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:35.518 INFO:teuthology.orchestra.run.smithi041:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:35.571 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T20:25:35.657 INFO:teuthology.orchestra.run.smithi041:> sudo service rsyslog restart 2020-07-16T20:25:35.700 INFO:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2020-07-16T20:25:35.750 INFO:teuthology.orchestra.run.smithi041.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T20:25:35.787 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T20:25:36.219 INFO:teuthology.run_tasks:Running task internal.timer... 2020-07-16T20:25:36.229 INFO:teuthology.task.internal:Starting timer... 2020-07-16T20:25:36.230 INFO:teuthology.run_tasks:Running task pcp... 2020-07-16T20:25:36.245 INFO:teuthology.run_tasks:Running task selinux... 2020-07-16T20:25:36.260 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-07-16T20:25:36.269 INFO:teuthology.orchestra.run.smithi041:> sudo service auditd rotate 2020-07-16T20:25:36.340 INFO:teuthology.orchestra.run.smithi041.stdout:Rotating logs: [ OK ] 2020-07-16T20:25:36.342 INFO:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2020-07-16T20:25:36.404 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: [ OK ] 2020-07-16T20:25:36.406 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-07-16T20:25:36.407 INFO:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2020-07-16T20:25:36.425 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2020-07-16T20:25:36.425 INFO:teuthology.orchestra.run.smithi041:> /usr/sbin/getenforce 2020-07-16T20:25:36.442 INFO:teuthology.orchestra.run.smithi041.stdout:Permissive 2020-07-16T20:25:36.443 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi041.front.sepia.ceph.com': 'permissive'} 2020-07-16T20:25:36.443 INFO:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T20:25:36.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:25:36.493 INFO:teuthology.orchestra.run.smithi041:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T20:25:36.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:25:36.530 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-07-16T20:25:36.531 INFO:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2020-07-16T20:25:36.594 INFO:teuthology.orchestra.run.smithi041:> sudo /usr/sbin/setenforce permissive 2020-07-16T20:25:36.649 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-07-16T20:25:36.677 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-07-16T20:25:36.688 INFO:teuthology.repo_utils:Fetching master from origin 2020-07-16T20:25:36.763 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-07-16T20:25:36.797 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-07-16T20:25:36.800 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi041.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-07-16T20:25:37.243 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-07-16T20:25:38.561 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-07-16T20:25:41.322 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-07-16T20:25:41.348 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:41 +0000 (0:00:00.084) 0:00:00.084 ********* 2020-07-16T20:25:41.379 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:41 +0000 (0:00:00.030) 0:00:00.114 ********* 2020-07-16T20:25:43.222 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi041.front.sepia.ceph.com] 2020-07-16T20:25:43.316 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:01.937) 0:00:02.052 ********* 2020-07-16T20:25:43.880 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-07-16T20:25:43.882 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:25:43.925 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.608) 0:00:02.660 ********* 2020-07-16T20:25:44.195 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-07-16T20:25:44.197 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] 2020-07-16T20:25:44.299 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.373) 0:00:03.034 ********* 2020-07-16T20:25:44.506 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-07-16T20:25:44.508 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:25:44.543 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.243) 0:00:03.278 ********* 2020-07-16T20:25:44.564 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-16T20:25:44.566 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T20:25:44.614 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.065) 0:00:03.344 ********* 2020-07-16T20:25:44.653 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-07-16T20:25:44.655 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:44.701 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.093) 0:00:03.437 ********* 2020-07-16T20:25:44.798 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-16T20:25:44.800 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T20:25:44.983 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.281) 0:00:03.718 ********* 2020-07-16T20:25:45.025 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-07-16T20:25:45.027 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:45.085 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:45 +0000 (0:00:00.102) 0:00:03.820 ********* 2020-07-16T20:25:45.251 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-07-16T20:25:45.253 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:45.308 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:45 +0000 (0:00:00.222) 0:00:04.043 ********* 2020-07-16T20:25:45.310 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:45.327 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:45.328 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:45.384 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:45 +0000 (0:00:00.076) 0:00:04.119 ********* 2020-07-16T20:25:45.387 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:46.500 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-07-16T20:25:46.502 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594931145.4128327-227416632163898/source", "state": "file", "uid": 0} 2020-07-16T20:25:46.538 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:46 +0000 (0:00:01.151) 0:00:05.271 ********* 2020-07-16T20:25:46.548 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594931145.331748-249716491730848/source", "state": "file", "uid": 0} 2020-07-16T20:25:46.601 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:46 +0000 (0:00:00.065) 0:00:05.336 ********* 2020-07-16T20:25:47.006 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-07-16T20:25:47.008 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-16T20:25:47.014 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T20:25:47.066 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-16T20:25:47.068 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T20:25:47.202 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-07-16T20:25:47.211 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-07-16T20:25:47.375 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:47 +0000 (0:00:00.773) 0:00:06.110 ********* 2020-07-16T20:25:47.416 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:47 +0000 (0:00:00.037) 0:00:06.148 ********* 2020-07-16T20:25:48.139 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-07-16T20:25:48.141 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] 2020-07-16T20:25:48.285 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-07-16T20:25:48.288 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:48 +0000 (0:00:00.872) 0:00:07.021 ********* 2020-07-16T20:25:49.097 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-16T20:25:49.099 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.214858", "end": "2020-07-16 20:25:49.055572", "rc": 0, "start": "2020-07-16 20:25:48.840714", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:49.154 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.862) 0:00:07.883 ********* 2020-07-16T20:25:49.163 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-07-16T20:25:49.174 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] 2020-07-16T20:25:49.257 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.109) 0:00:07.992 ********* 2020-07-16T20:25:49.387 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006171", "end": "2020-07-16 20:25:49.359504", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:49.353333", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:49.447 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.189) 0:00:08.182 ********* 2020-07-16T20:25:49.486 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-07-16T20:25:49.488 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-07-16T20:25:49.537 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.090) 0:00:08.272 ********* 2020-07-16T20:25:49.602 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-07-16T20:25:49.604 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.643 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.105) 0:00:08.378 ********* 2020-07-16T20:25:49.697 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-16T20:25:49.699 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.193418", "end": "2020-07-16 20:25:49.647616", "rc": 0, "start": "2020-07-16 20:25:49.454198", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:49.733 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.090) 0:00:08.469 ********* 2020-07-16T20:25:49.745 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-07-16T20:25:49.747 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.804 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.068) 0:00:08.537 ********* 2020-07-16T20:25:49.846 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-07-16T20:25:49.848 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.904 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.101) 0:00:08.639 ********* 2020-07-16T20:25:49.946 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-07-16T20:25:49.950 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.998 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.093) 0:00:08.733 ********* 2020-07-16T20:25:50.010 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-07-16T20:25:50.012 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007061", "end": "2020-07-16 20:25:49.967151", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:49.960090", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:50.047 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.049) 0:00:08.782 ********* 2020-07-16T20:25:50.056 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-07-16T20:25:50.058 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.109 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.061) 0:00:08.844 ********* 2020-07-16T20:25:50.128 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-07-16T20:25:50.131 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-07-16T20:25:50.184 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.074) 0:00:08.919 ********* 2020-07-16T20:25:50.199 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T20:25:50.202 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.213 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.216 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.226 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.227 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-07-16T20:25:50.229 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.291 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.107) 0:00:09.027 ********* 2020-07-16T20:25:50.306 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T20:25:50.308 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.309 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.310 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.312 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2020-07-16T20:25:50.314 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6I 2020-07-16T20:25:50.316 INFO:teuthology.task.ansible.out:nynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.317 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8 2020-07-16T20:25:50.321 INFO:teuthology.task.ansible.out:595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu 2020-07-16T20:25:50.323 INFO:teuthology.task.ansible.out:16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.332 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.426 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.134) 0:00:09.162 ********* 2020-07-16T20:25:50.449 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.451 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.453 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.453 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.455 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.467 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.470 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.470 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": 2020-07-16T20:25:50.472 INFO:teuthology.task.ansible.out:false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.488 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.498 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.510 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.512 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.566 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.139) 0:00:09.302 ********* 2020-07-16T20:25:50.589 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.592 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.593 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.618 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-07-16T20:25:50.620 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.658 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.091) 0:00:09.393 ********* 2020-07-16T20:25:50.674 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.676 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.678 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.679 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.681 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.693 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.694 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.708 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.714 INFO:teuthology.task.ansible.out:TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T20:25:50.714 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.715 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.716 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.718 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.761 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.103) 0:00:09.496 ********* 2020-07-16T20:25:50.775 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.776 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.778 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.778 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.779 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.779 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.779 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hch 2020-07-16T20:25:50.781 INFO:teuthology.task.ansible.out:en@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.793 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.794 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.805 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.807 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.849 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.850 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.851 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.853 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.855 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.869 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.869 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.871 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.882 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.884 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.886 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.902 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.904 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.915 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.916 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.917 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.919 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.930 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.973 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.974 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.976 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.977 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.979 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.980 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.981 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.982 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:50.984 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.984 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.033 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.034 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVN 2020-07-16T20:25:51.036 INFO:teuthology.task.ansible.out:TUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.038 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.039 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.042 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.043 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.045 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:51.046 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.046 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:51.047 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.048 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.050 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.052 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.052 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce66 2020-07-16T20:25:51.054 INFO:teuthology.task.ansible.out:8079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.120 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.122 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.122 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.123 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'n 2020-07-16T20:25:51.124 INFO:teuthology.task.ansible.out:ame': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.125 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.141 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.146 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.182 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.196 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.198 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.200 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.204 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.205 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.206 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.210 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.212 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.212 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.213 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph 2020-07-16T20:25:51.215 INFO:teuthology.task.ansible.out:0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.216 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.216 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.217 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a8 2020-07-16T20:25:51.219 INFO:teuthology.task.ansible.out:1fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.229 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.231 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.232 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.233 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@v 2020-07-16T20:25:51.235 INFO:teuthology.task.ansible.out:umrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.237 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.242 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZT 2020-07-16T20:25:51.244 INFO:teuthology.task.ansible.out:bxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.252 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.254 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.266 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.268 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.269 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.285 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.296 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.301 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.315 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.326 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.339 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.341 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.342 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.343 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.344 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item 2020-07-16T20:25:51.346 INFO:teuthology.task.ansible.out:", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.355 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.379 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.386 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.442 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.681) 0:00:10.178 ********* 2020-07-16T20:25:51.455 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.457 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.469 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.471 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.472 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.473 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRX 2020-07-16T20:25:51.478 INFO:teuthology.task.ansible.out:lHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.486 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.488 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.539 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.095) 0:00:10.273 ********* 2020-07-16T20:25:51.553 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.555 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.556 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.556 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1f 2020-07-16T20:25:51.558 INFO:teuthology.task.ansible.out:b0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.573 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.582 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.632 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.094) 0:00:10.368 ********* 2020-07-16T20:25:51.644 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.646 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.647 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.648 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.648 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.650 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4ires 2020-07-16T20:25:51.651 INFO:teuthology.task.ansible.out:is", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.694 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-16T20:25:51.696 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.697 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.697 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'z 2020-07-16T20:25:51.699 INFO:teuthology.task.ansible.out:dover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.787 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.153) 0:00:10.521 ********* 2020-07-16T20:25:51.818 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.821 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.823 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.823 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.825 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.840 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.842 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.843 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T20:25:51.843 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.845 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.898 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.111) 0:00:10.633 ********* 2020-07-16T20:25:51.910 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.911 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.916 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.943 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.992 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.093) 0:00:10.727 ********* 2020-07-16T20:25:52.070 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.077) 0:00:10.805 ********* 2020-07-16T20:25:52.080 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-16T20:25:52.126 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.054) 0:00:10.859 ********* 2020-07-16T20:25:52.134 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-07-16T20:25:52.135 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.196 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.071) 0:00:10.931 ********* 2020-07-16T20:25:52.205 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-07-16T20:25:52.207 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.262 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.063) 0:00:10.995 ********* 2020-07-16T20:25:52.288 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T20:25:52.289 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.291 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.293 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.305 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-16T20:25:52.306 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.346 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.086) 0:00:11.081 ********* 2020-07-16T20:25:52.361 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T20:25:52.363 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.364 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.366 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.368 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.369 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.371 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.382 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.394 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.396 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.406 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.407 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.415 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi157.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.473 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.126) 0:00:11.208 ********* 2020-07-16T20:25:52.484 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.487 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.487 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.505 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.515 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.581 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.107) 0:00:11.316 ********* 2020-07-16T20:25:52.605 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T20:25:52.608 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.610 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.626 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.653 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.663 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.665 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.671 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-07-16T20:25:52.672 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.721 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.140) 0:00:11.456 ********* 2020-07-16T20:25:52.784 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.061) 0:00:11.518 ********* 2020-07-16T20:25:52.795 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T20:25:52.797 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.819 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.855 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.857 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.904 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.906 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.918 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.933 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.940 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.964 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.966 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.967 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.968 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.980 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.982 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.014 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.016 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.018 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.020 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.022 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.026 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.043 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.045 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.047 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.057 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.058 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.070 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.130 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.347) 0:00:11.865 ********* 2020-07-16T20:25:53.719 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-07-16T20:25:53.730 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-07-16T20:25:53.766 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.636) 0:00:12.502 ********* 2020-07-16T20:25:53.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.045) 0:00:12.548 ********* 2020-07-16T20:25:53.821 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-16T20:25:53.823 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => { "msg": "Host smithi041.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-07-16T20:25:53.864 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.051) 0:00:12.599 ********* 2020-07-16T20:25:53.874 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => { "msg": "Host smithi157.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-07-16T20:25:53.923 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.059) 0:00:12.658 ********* 2020-07-16T20:25:53.937 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-07-16T20:25:53.938 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-07-16T20:25:53.982 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.058) 0:00:12.717 ********* 2020-07-16T20:25:53.993 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-07-16T20:25:54.033 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.050) 0:00:12.768 ********* 2020-07-16T20:25:54.044 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:54.091 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.057) 0:00:12.826 ********* 2020-07-16T20:25:54.101 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:54.139 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.048) 0:00:12.874 ********* 2020-07-16T20:25:54.694 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.329213", "end": "2020-07-16 20:25:54.638784", "rc": 0, "start": "2020-07-16 20:25:54.309571", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T20:25:54.731 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.592) 0:00:13.466 ********* 2020-07-16T20:25:54.741 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.348002", "end": "2020-07-16 20:25:54.689121", "rc": 0, "start": "2020-07-16 20:25:54.341119", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T20:25:54.801 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.069) 0:00:13.536 ********* 2020-07-16T20:25:54.812 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-07-16T20:25:54.814 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:54.865 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.064) 0:00:13.601 ********* 2020-07-16T20:25:54.882 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:54.939 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.073) 0:00:13.674 ********* 2020-07-16T20:25:54.958 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-16T20:25:54.960 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.001 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.053) 0:00:13.728 ********* 2020-07-16T20:25:55.002 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.040 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.047) 0:00:13.775 ********* 2020-07-16T20:25:55.049 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-07-16T20:25:55.051 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.100 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.060) 0:00:13.835 ********* 2020-07-16T20:25:55.120 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.170 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.062) 0:00:13.898 ********* 2020-07-16T20:25:55.175 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.218 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.054) 0:00:13.953 ********* 2020-07-16T20:25:55.230 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.268 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.050) 0:00:14.004 ********* 2020-07-16T20:25:55.277 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-16T20:25:55.279 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.330 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.061) 0:00:14.066 ********* 2020-07-16T20:25:55.341 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.402 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.069) 0:00:14.135 ********* 2020-07-16T20:25:55.420 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.467 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.067) 0:00:14.202 ********* 2020-07-16T20:25:55.478 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.533 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.065) 0:00:14.268 ********* 2020-07-16T20:25:55.546 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi041.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.549 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.584 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.050) 0:00:14.319 ********* 2020-07-16T20:25:55.602 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.603 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.650 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.065) 0:00:14.385 ********* 2020-07-16T20:25:55.662 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-16T20:25:55.664 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.718 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.068) 0:00:14.454 ********* 2020-07-16T20:25:55.728 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.766 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.048) 0:00:14.502 ********* 2020-07-16T20:25:55.776 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-07-16T20:25:55.778 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.814 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.047) 0:00:14.549 ********* 2020-07-16T20:25:55.824 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:55.875 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.061) 0:00:14.610 ********* 2020-07-16T20:25:55.885 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-07-16T20:25:55.887 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.940 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.064) 0:00:14.675 ********* 2020-07-16T20:25:55.951 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:55.999 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.059) 0:00:14.734 ********* 2020-07-16T20:25:56.012 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-07-16T20:25:56.014 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.060 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.061) 0:00:14.796 ********* 2020-07-16T20:25:56.073 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.134 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.073) 0:00:14.869 ********* 2020-07-16T20:25:56.147 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-16T20:25:56.149 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:56.200 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.065) 0:00:14.935 ********* 2020-07-16T20:25:56.211 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:56.265 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.065) 0:00:15.000 ********* 2020-07-16T20:25:56.274 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-07-16T20:25:56.276 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.311 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.045) 0:00:15.046 ********* 2020-07-16T20:25:56.323 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.361 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.050) 0:00:15.096 ********* 2020-07-16T20:25:56.370 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-16T20:25:56.372 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.407 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.045) 0:00:15.142 ********* 2020-07-16T20:25:56.416 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.452 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.045) 0:00:15.188 ********* 2020-07-16T20:25:56.461 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-07-16T20:25:56.463 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.512 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.059) 0:00:15.247 ********* 2020-07-16T20:25:56.531 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.593 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.080) 0:00:15.328 ********* 2020-07-16T20:25:56.605 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-07-16T20:25:56.608 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.658 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.065) 0:00:15.394 ********* 2020-07-16T20:25:56.669 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.709 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.050) 0:00:15.444 ********* 2020-07-16T20:25:56.733 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-07-16T20:25:56.735 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:56.776 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.067) 0:00:15.512 ********* 2020-07-16T20:25:56.788 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:56.828 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.051) 0:00:15.563 ********* 2020-07-16T20:25:56.846 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.894 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.066) 0:00:15.630 ********* 2020-07-16T20:25:56.905 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.948 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.053) 0:00:15.683 ********* 2020-07-16T20:25:56.958 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-07-16T20:25:56.960 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:56.997 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.048) 0:00:15.732 ********* 2020-07-16T20:25:57.007 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.052 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.055) 0:00:15.788 ********* 2020-07-16T20:25:57.063 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-07-16T20:25:57.065 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.109 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.056) 0:00:15.844 ********* 2020-07-16T20:25:57.122 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.182 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.073) 0:00:15.918 ********* 2020-07-16T20:25:57.202 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-16T20:25:57.204 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.243 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.060) 0:00:15.978 ********* 2020-07-16T20:25:57.254 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.310 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.066) 0:00:16.045 ********* 2020-07-16T20:25:57.330 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.365 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.055) 0:00:16.100 ********* 2020-07-16T20:25:57.377 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.426 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.061) 0:00:16.162 ********* 2020-07-16T20:25:57.437 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-07-16T20:25:57.438 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.482 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.055) 0:00:16.217 ********* 2020-07-16T20:25:57.493 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.536 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.054) 0:00:16.272 ********* 2020-07-16T20:25:57.553 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-07-16T20:25:57.555 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:57.602 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.060) 0:00:16.332 ********* 2020-07-16T20:25:57.619 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:57.664 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.067) 0:00:16.400 ********* 2020-07-16T20:25:57.682 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.712 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.048) 0:00:16.448 ********* 2020-07-16T20:25:57.723 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.771 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.058) 0:00:16.506 ********* 2020-07-16T20:25:57.780 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-07-16T20:25:57.782 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.858 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.064) 0:00:16.571 ********* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:57.894 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.058) 0:00:16.629 ********* 2020-07-16T20:25:58.098 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-07-16T20:25:58.101 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:58.144 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:58 +0000 (0:00:00.250) 0:00:16.879 ********* 2020-07-16T20:25:58.162 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:58.214 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:58 +0000 (0:00:00.070) 0:00:16.950 ********* 2020-07-16T20:25:58.789 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T20:25:58.831 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T20:25:59.315 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T20:25:59.367 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:59 +0000 (0:00:01.152) 0:00:18.103 ********* 2020-07-16T20:25:59.386 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T20:25:59.432 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:59 +0000 (0:00:00.062) 0:00:18.165 ********* 2020-07-16T20:25:59.935 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-16T20:25:59.938 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T20:25:59.977 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T20:25:59.979 INFO:teuthology.task.ansible.out: 2020-07-16T20:26:00.478 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T20:26:00.539 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:01.109) 0:00:19.274 ********* 2020-07-16T20:26:00.557 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T20:26:00.604 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.064) 0:00:19.338 ********* 2020-07-16T20:26:00.614 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.660 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.056) 0:00:19.395 ********* 2020-07-16T20:26:00.670 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.712 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.051) 0:00:19.447 ********* 2020-07-16T20:26:00.724 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:26:00.726 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.768 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.056) 0:00:19.504 ********* 2020-07-16T20:26:00.779 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.824 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.055) 0:00:19.559 ********* 2020-07-16T20:26:00.835 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-16T20:26:00.837 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.874 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.049) 0:00:19.608 ********* 2020-07-16T20:26:00.887 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.928 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.055) 0:00:19.664 ********* 2020-07-16T20:26:00.940 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-07-16T20:26:00.942 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:00.982 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:00 +0000 (0:00:00.053) 0:00:19.717 ********* 2020-07-16T20:26:00.995 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.054 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.064) 0:00:19.782 ********* 2020-07-16T20:26:01.056 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:26:01.058 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.105 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.054) 0:00:19.836 ********* 2020-07-16T20:26:01.117 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.160 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.057) 0:00:19.894 ********* 2020-07-16T20:26:01.169 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.215 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.052) 0:00:19.947 ********* 2020-07-16T20:26:01.243 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.294 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.082) 0:00:20.030 ********* 2020-07-16T20:26:01.305 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-07-16T20:26:01.310 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.363 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.069) 0:00:20.099 ********* 2020-07-16T20:26:01.378 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.423 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.059) 0:00:20.159 ********* 2020-07-16T20:26:01.436 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-07-16T20:26:01.437 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.479 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.055) 0:00:20.214 ********* 2020-07-16T20:26:01.495 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.533 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.053) 0:00:20.268 ********* 2020-07-16T20:26:01.542 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-07-16T20:26:01.544 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.579 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.045) 0:00:20.314 ********* 2020-07-16T20:26:01.588 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:01.627 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:01 +0000 (0:00:00.048) 0:00:20.362 ********* 2020-07-16T20:26:02.519 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-07-16T20:26:02.528 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.670437", "end": "2020-07-16 20:26:02.500352", "rc": 0, "start": "2020-07-16 20:26:01.829915", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:02.530 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.725516", "end": "2020-07-16 20:26:02.500735", "rc": 0, "start": "2020-07-16 20:26:01.775219", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:02.564 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:02 +0000 (0:00:00.936) 0:00:21.299 ********* 2020-07-16T20:26:02.602 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:02 +0000 (0:00:00.038) 0:00:21.338 ********* 2020-07-16T20:26:03.921 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-07-16T20:26:03.922 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T20:26:03.958 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:03 +0000 (0:00:01.355) 0:00:22.693 ********* 2020-07-16T20:26:03.967 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T20:26:04.012 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.049) 0:00:22.742 ********* 2020-07-16T20:26:04.017 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.056 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.048) 0:00:22.790 ********* 2020-07-16T20:26:04.068 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.130 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.067) 0:00:22.858 ********* 2020-07-16T20:26:04.133 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-07-16T20:26:04.135 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.177 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.054) 0:00:22.912 ********* 2020-07-16T20:26:04.191 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.247 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.069) 0:00:22.982 ********* 2020-07-16T20:26:04.258 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-07-16T20:26:04.260 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.314 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.066) 0:00:23.049 ********* 2020-07-16T20:26:04.324 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.370 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.056) 0:00:23.106 ********* 2020-07-16T20:26:04.380 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-07-16T20:26:04.382 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.418 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.047) 0:00:23.154 ********* 2020-07-16T20:26:04.427 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:04.467 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:04 +0000 (0:00:00.048) 0:00:23.202 ********* 2020-07-16T20:26:04.937 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T20:26:05.009 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:05 +0000 (0:00:00.542) 0:00:23.744 ********* 2020-07-16T20:26:05.031 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T20:26:05.070 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:05 +0000 (0:00:00.061) 0:00:23.806 ********* 2020-07-16T20:26:05.911 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T20:26:05.955 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:05 +0000 (0:00:00.883) 0:00:24.690 ********* 2020-07-16T20:26:06.130 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T20:26:06.183 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:06 +0000 (0:00:00.227) 0:00:24.917 ********* 2020-07-16T20:26:06.503 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-07-16T20:26:06.512 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T20:26:06.773 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T20:26:07.066 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T20:26:07.333 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T20:26:07.666 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T20:26:07.714 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:07 +0000 (0:00:01.532) 0:00:26.450 ********* 2020-07-16T20:26:07.909 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T20:26:07.958 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:07 +0000 (0:00:00.243) 0:00:26.694 ********* 2020-07-16T20:26:07.970 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-07-16T20:26:07.972 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:26:08.013 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:08 +0000 (0:00:00.055) 0:00:26.749 ********* 2020-07-16T20:26:08.199 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:26:08.245 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:08 +0000 (0:00:00.232) 0:00:26.981 ********* 2020-07-16T20:26:08.523 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T20:26:08.525 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T20:26:08.829 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T20:26:09.011 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T20:26:09.344 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T20:26:09.539 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T20:26:09.586 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:09 +0000 (0:00:01.341) 0:00:28.322 ********* 2020-07-16T20:26:09.627 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T20:26:09.634 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:09.664 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:09 +0000 (0:00:00.077) 0:00:28.399 ********* 2020-07-16T20:26:09.710 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T20:26:09.712 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T20:26:09.750 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:09 +0000 (0:00:00.085) 0:00:28.485 ********* 2020-07-16T20:26:09.857 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T20:26:09.859 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T20:26:09.901 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:09 +0000 (0:00:00.151) 0:00:28.637 ********* 2020-07-16T20:26:09.943 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T20:26:09.946 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:09.988 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:09 +0000 (0:00:00.086) 0:00:28.723 ********* 2020-07-16T20:26:10.000 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-16T20:26:10.002 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T20:26:10.054 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:10 +0000 (0:00:00.065) 0:00:28.789 ********* 2020-07-16T20:26:10.065 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T20:26:10.067 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T20:26:10.102 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:10 +0000 (0:00:00.048) 0:00:28.837 ********* 2020-07-16T20:26:10.123 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-16T20:26:10.125 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.145 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:10 +0000 (0:00:00.082) 0:00:28.920 ********* 2020-07-16T20:26:10.327 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-16T20:26:10.329 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T20:26:10.391 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:10 +0000 (0:00:00.205) 0:00:29.126 ********* 2020-07-16T20:26:10.455 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-16T20:26:10.457 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.467 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.479 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.490 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:10.544 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:10 +0000 (0:00:00.152) 0:00:29.279 ********* 2020-07-16T20:26:11.140 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-07-16T20:26:11.177 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:11 +0000 (0:00:00.633) 0:00:29.912 ********* 2020-07-16T20:26:11.232 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T20:26:11.234 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:11.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:11 +0000 (0:00:00.096) 0:00:30.009 ********* 2020-07-16T20:26:11.523 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-16T20:26:11.525 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-07-16T20:26:11.566 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:11 +0000 (0:00:00.292) 0:00:30.301 ********* 2020-07-16T20:26:11.617 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T20:26:11.619 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:11.658 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:11 +0000 (0:00:00.091) 0:00:30.392 ********* 2020-07-16T20:26:11.796 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-07-16T20:26:11.798 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T20:26:11.866 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:11 +0000 (0:00:00.208) 0:00:30.601 ********* 2020-07-16T20:26:12.213 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T20:26:12.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:12 +0000 (0:00:00.405) 0:00:31.007 ********* 2020-07-16T20:26:12.417 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-16T20:26:12.419 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T20:26:12.459 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:12 +0000 (0:00:00.187) 0:00:31.194 ********* 2020-07-16T20:26:12.505 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T20:26:12.507 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:12.516 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:12.553 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:12 +0000 (0:00:00.093) 0:00:31.288 ********* 2020-07-16T20:26:12.777 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T20:26:12.779 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:26:12.818 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:12 +0000 (0:00:00.266) 0:00:31.554 ********* 2020-07-16T20:26:12.843 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-16T20:26:12.845 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T20:26:12.900 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:12 +0000 (0:00:00.080) 0:00:31.635 ********* 2020-07-16T20:26:12.951 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T20:26:12.953 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:12.962 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:13.014 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.108) 0:00:31.743 ********* 2020-07-16T20:26:13.080 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T20:26:13.124 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.115) 0:00:31.859 ********* 2020-07-16T20:26:13.169 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T20:26:13.171 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:13.225 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.097) 0:00:31.956 ********* 2020-07-16T20:26:13.270 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T20:26:13.279 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:26:13.318 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.093) 0:00:32.050 ********* 2020-07-16T20:26:13.587 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi041.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T20:26:13.630 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.315) 0:00:32.365 ********* 2020-07-16T20:26:13.662 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T20:26:13.664 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:13.697 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.066) 0:00:32.432 ********* 2020-07-16T20:26:13.752 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-16T20:26:13.754 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-07-16T20:26:13.794 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:13 +0000 (0:00:00.097) 0:00:32.530 ********* 2020-07-16T20:26:14.265 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-07-16T20:26:14.319 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:14 +0000 (0:00:00.524) 0:00:33.054 ********* 2020-07-16T20:26:14.733 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-07-16T20:26:14.735 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:41 UTC", "ActiveEnterTimestampMonotonic": "15823234", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount system.slice time-sync.target nss-lookup.target basic.target -.mount sysinit.target network.target var-run.mount systemd-tmpfiles-setup.service systemd-journald.socket local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:41 UTC", "AssertTimestampMonotonic": "15822399", "Before": "getty@tty1.service shutdown.target plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:41 UTC", "ConditionTimestampMonotonic": "15822398", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-07-16T20:26:14.736 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2484", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:41 UTC", "ExecMainStartTimestampMonotonic": "15823199", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:41 UTC] ; stop_time=[n/a] ; pid=2484 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:41 UTC", "InactiveExitTimestampMonotonic": "15823234", "InvocationID": "7ef24afd657b45ceae9cfaae5bbd8268", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-07-16T20:26:14.738 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2484", "MemoryAccounting": "yes", "MemoryCurrent": "1249280", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-07-16T20:26:14.740 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:41 UTC", "StateChangeTimestampMonotonic": "15823234", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:41 UTC", "WatchdogTimestampMonotonic": "15823232", "WatchdogUSec": "0"}} 2020-07-16T20:26:14.780 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:14 +0000 (0:00:00.460) 0:00:33.515 ********* 2020-07-16T20:26:14.793 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:23:56 UTC", "ActiveEnterTimestampMonotonic": "19538803", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount network.target local-fs.target systemd-journald.socket time-sync.target sysinit.target nss-lookup.target system.slice -.mount basic.target systemd-tmpfiles-setup.service var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:23:56 UTC", "AssertTimestampMonotonic": "19538036", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:23:56 UTC", "ConditionTimestampMonotonic": "19538034", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-07-16T20:26:14.795 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2495", "ExecMainStartTimestamp": "Thu 2020-07-16 20:23:56 UTC", "ExecMainStartTimestampMonotonic": "19538765", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:23:56 UTC] ; stop_time=[n/a] ; pid=2495 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:23:56 UTC", "InactiveExitTimestampMonotonic": "19538803", "InvocationID": "233a048c4ef9450abfc5b9a3688164da", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-07-16T20:26:14.797 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2495", "MemoryAccounting": "yes", "MemoryCurrent": "1261568", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-07-16T20:26:14.799 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:23:56 UTC", "StateChangeTimestampMonotonic": "19538803", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:23:56 UTC", "WatchdogTimestampMonotonic": "19538802", "WatchdogUSec": "0"}} 2020-07-16T20:26:14.834 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:14 +0000 (0:00:00.054) 0:00:33.569 ********* 2020-07-16T20:26:14.990 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001730", "end": "2020-07-16 20:26:14.960065", "rc": 0, "start": "2020-07-16 20:26:14.958335", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T20:26:15.028 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.194) 0:00:33.763 ********* 2020-07-16T20:26:15.064 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001785", "end": "2020-07-16 20:26:15.042492", "rc": 0, "start": "2020-07-16 20:26:15.040707", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T20:26:15.124 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.095) 0:00:33.859 ********* 2020-07-16T20:26:15.960 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-07-16T20:26:15.962 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T20:26:16.006 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.881) 0:00:34.741 ********* 2020-07-16T20:26:16.129 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T20:26:16.131 INFO:teuthology.task.ansible.out: 2020-07-16T20:26:16.210 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:16 +0000 (0:00:00.204) 0:00:34.945 ********* 2020-07-16T20:26:16.992 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-07-16T20:26:17.065 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:17 +0000 (0:00:00.849) 0:00:35.795 ********* 2020-07-16T20:26:17.214 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-07-16T20:26:17.266 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:17 +0000 (0:00:00.206) 0:00:36.001 ********* 2020-07-16T20:26:18.592 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-07-16T20:26:18.593 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T20:26:18.651 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:18 +0000 (0:00:01.385) 0:00:37.386 ********* 2020-07-16T20:26:18.664 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T20:26:18.703 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:18 +0000 (0:00:00.052) 0:00:37.439 ********* 2020-07-16T20:26:35.211 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-07-16T20:26:35.215 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.275792", "end": "2020-07-16 20:26:35.178028", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:26:18.902236", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T20:26:35.268 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:16.564) 0:00:54.003 ********* 2020-07-16T20:26:35.812 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-16T20:26:35.815 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.920732", "end": "2020-07-16 20:26:35.781659", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:26:18.860927", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T20:26:35.869 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.601) 0:00:54.605 ********* 2020-07-16T20:26:35.911 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.041) 0:00:54.647 ********* 2020-07-16T20:26:36.149 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009642", "end": "2020-07-16 20:26:36.126058", "rc": 0, "start": "2020-07-16 20:26:36.116416", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:36.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.274) 0:00:54.921 ********* 2020-07-16T20:26:36.458 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-16T20:26:36.460 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011145", "end": "2020-07-16 20:26:36.428095", "rc": 0, "start": "2020-07-16 20:26:36.416950", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:36.498 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.311) 0:00:55.233 ********* 2020-07-16T20:26:36.556 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.058) 0:00:55.291 ********* 2020-07-16T20:26:36.733 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-07-16T20:26:36.735 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014075", "end": "2020-07-16 20:26:36.710212", "rc": 0, "start": "2020-07-16 20:26:36.696137", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:36.772 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.215) 0:00:55.507 ********* 2020-07-16T20:26:37.033 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.007584", "end": "2020-07-16 20:26:37.006865", "rc": 0, "start": "2020-07-16 20:26:36.999281", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:37.094 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:37 +0000 (0:00:00.319) 0:00:55.827 ********* 2020-07-16T20:26:53.040 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-16T20:26:53.043 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.253679", "end": "2020-07-16 20:26:53.000866", "rc": 0, "start": "2020-07-16 20:26:36.747187", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:53.095 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:16.003) 0:01:11.831 ********* 2020-07-16T20:26:53.332 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-16T20:26:53.334 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T20:26:53.389 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:00.293) 0:01:12.124 ********* 2020-07-16T20:26:53.448 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-16T20:26:53.450 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T20:26:53.490 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:00.101) 0:01:12.226 ********* 2020-07-16T20:26:53.542 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-16T20:26:53.544 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:53.583 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:00.092) 0:01:12.319 ********* 2020-07-16T20:26:53.658 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T20:26:53.660 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-07-16T20:26:53.709 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:00.125) 0:01:12.444 ********* 2020-07-16T20:26:53.774 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-07-16T20:26:53.776 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:53.814 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:53 +0000 (0:00:00.105) 0:01:12.550 ********* 2020-07-16T20:26:54.055 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-16T20:26:54.057 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:26:54.095 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.280) 0:01:12.830 ********* 2020-07-16T20:26:54.172 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-16T20:26:54.177 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.850276", "end": "2020-07-16 20:26:54.141367", "rc": 0, "start": "2020-07-16 20:26:37.291091", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:54.221 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.125) 0:01:12.956 ********* 2020-07-16T20:26:54.324 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-07-16T20:26:54.326 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T20:26:54.361 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.139) 0:01:13.096 ********* 2020-07-16T20:26:54.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-07-16T20:26:54.404 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:54.439 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.077) 0:01:13.174 ********* 2020-07-16T20:26:54.470 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-16T20:26:54.472 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T20:26:54.521 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.079) 0:01:13.253 ********* 2020-07-16T20:26:54.529 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-16T20:26:54.531 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:54.572 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.054) 0:01:13.308 ********* 2020-07-16T20:26:54.585 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-16T20:26:54.587 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T20:26:54.627 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.054) 0:01:13.362 ********* 2020-07-16T20:26:54.684 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-16T20:26:54.686 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:54.724 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.097) 0:01:13.459 ********* 2020-07-16T20:26:54.787 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T20:26:54.790 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-07-16T20:26:54.840 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.115) 0:01:13.575 ********* 2020-07-16T20:26:54.850 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-16T20:26:54.852 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-07-16T20:26:54.889 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.049) 0:01:13.625 ********* 2020-07-16T20:26:54.911 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-07-16T20:26:54.913 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:54.966 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:00.076) 0:01:13.701 ********* 2020-07-16T20:26:55.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-16T20:26:55.233 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:26:55.291 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.324) 0:01:14.026 ********* 2020-07-16T20:26:55.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T20:26:55.583 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.291) 0:01:14.318 ********* 2020-07-16T20:26:55.607 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-16T20:26:55.609 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T20:26:55.672 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.087) 0:01:14.405 ********* 2020-07-16T20:26:55.694 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:55.735 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.064) 0:01:14.470 ********* 2020-07-16T20:26:55.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-07-16T20:26:55.747 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi157"}, "changed": false} 2020-07-16T20:26:55.788 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.053) 0:01:14.524 ********* 2020-07-16T20:26:55.811 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-16T20:26:55.814 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:55.866 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.071) 0:01:14.595 ********* 2020-07-16T20:26:56.131 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-16T20:26:56.133 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-07-16T20:26:56.183 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:56 +0000 (0:00:00.319) 0:01:14.915 ********* 2020-07-16T20:26:56.843 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-16T20:26:56.845 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T20:26:56.890 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:56 +0000 (0:00:00.710) 0:01:15.625 ********* 2020-07-16T20:26:56.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi041"}, "changed": false} 2020-07-16T20:26:56.979 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:56 +0000 (0:00:00.089) 0:01:15.715 ********* 2020-07-16T20:26:57.077 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi157", "ansible_hostname": "smithi157", "ansible_nodename": "smithi157"}, "changed": false, "name": "smithi157"} 2020-07-16T20:26:57.119 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.140) 0:01:15.855 ********* 2020-07-16T20:26:57.623 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi041", "ansible_hostname": "smithi041", "ansible_nodename": "smithi041"}, "changed": false, "name": "smithi041"} 2020-07-16T20:26:57.684 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.564) 0:01:16.420 ********* 2020-07-16T20:26:57.702 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-07-16T20:26:57.704 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T20:26:57.764 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.079) 0:01:16.500 ********* 2020-07-16T20:26:58.261 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T20:26:58.296 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.531) 0:01:17.032 ********* 2020-07-16T20:26:58.354 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-07-16T20:26:58.356 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T20:26:58.436 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.139) 0:01:17.171 ********* 2020-07-16T20:26:58.922 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T20:26:58.962 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.525) 0:01:17.696 ********* 2020-07-16T20:26:59.088 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T20:26:59.128 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.167) 0:01:17.863 ********* 2020-07-16T20:26:59.130 INFO:teuthology.task.ansible.out: 2020-07-16T20:26:59.657 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T20:26:59.694 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.566) 0:01:18.430 ********* 2020-07-16T20:26:59.708 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-07-16T20:26:59.710 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T20:26:59.762 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.067) 0:01:18.497 ********* 2020-07-16T20:27:00.003 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:27:00.005 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:00.043 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.281) 0:01:18.778 ********* 2020-07-16T20:27:00.277 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} TASK [testnode : Create remote.conf] ******************************************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T20:27:00.318 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.274) 0:01:19.053 ********* 2020-07-16T20:27:00.370 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.048) 0:01:19.101 ********* 2020-07-16T20:27:00.551 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:27:00.553 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:00.588 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.221) 0:01:19.323 ********* 2020-07-16T20:27:00.630 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi157.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1224, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T20:27:00.673 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.085) 0:01:19.408 ********* 2020-07-16T20:27:00.823 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:27:00.825 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-07-16T20:27:00.863 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.190) 0:01:19.599 ********* 2020-07-16T20:27:01.130 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:27:01.133 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1224, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T20:27:01.168 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.304) 0:01:19.903 ********* 2020-07-16T20:27:01.259 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:01.263 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:27:01.265 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T20:27:01.272 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:01.315 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.146) 0:01:20.050 ********* 2020-07-16T20:27:01.737 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T20:27:01.806 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.484) 0:01:20.535 ********* 2020-07-16T20:27:01.902 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:27:01.904 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T20:27:01.938 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.138) 0:01:20.674 ********* 2020-07-16T20:27:02.390 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T20:27:02.445 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.505) 0:01:21.179 ********* 2020-07-16T20:27:03.809 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:27:03.811 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.656900", "end": "2020-07-16 20:27:03.777378", "rc": 0, "start": "2020-07-16 20:27:02.120478", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:03.846 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:01.401) 0:01:22.581 ********* 2020-07-16T20:27:04.401 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:27:04.404 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-07-16T20:27:04.467 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:27:04.468 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.783941", "end": "2020-07-16 20:27:04.437369", "rc": 0, "start": "2020-07-16 20:27:02.653428", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:04.526 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.680) 0:01:23.261 ********* 2020-07-16T20:27:04.927 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:27:04.929 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-07-16T20:27:05.172 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-07-16T20:27:05.468 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-07-16T20:27:05.524 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.989) 0:01:24.251 ********* 2020-07-16T20:27:05.739 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-07-16T20:27:06.058 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T20:27:06.166 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.650) 0:01:24.901 ********* 2020-07-16T20:27:06.343 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi041.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-07-16T20:27:06.434 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.255) 0:01:25.157 ********* 2020-07-16T20:27:06.806 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:27:06.808 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-07-16T20:27:07.086 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-16T20:27:07.088 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T20:27:07.134 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.712) 0:01:25.870 ********* 2020-07-16T20:27:07.406 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:27:07.408 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-07-16T20:27:07.780 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-07-16T20:27:07.958 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-07-16T20:27:08.015 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.879) 0:01:26.750 ********* 2020-07-16T20:27:08.047 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T20:27:08.093 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.078) 0:01:26.829 ********* 2020-07-16T20:27:08.136 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-16T20:27:08.138 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.092) 0:01:26.921 ********* 2020-07-16T20:27:08.238 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-16T20:27:08.240 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.251 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.308 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.121) 0:01:27.043 ********* 2020-07-16T20:27:08.344 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:27:08.349 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-07-16T20:27:08.357 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.401 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.092) 0:01:27.136 ********* 2020-07-16T20:27:08.443 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:08.445 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-07-16T20:27:08.480 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.078) 0:01:27.215 ********* 2020-07-16T20:27:08.525 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-16T20:27:08.527 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.575 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.094) 0:01:27.310 ********* 2020-07-16T20:27:08.621 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T20:27:08.624 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.665 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.089) 0:01:27.399 ********* 2020-07-16T20:27:08.868 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:27:08.870 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-07-16T20:27:08.946 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.274) 0:01:27.674 ********* 2020-07-16T20:27:08.959 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007008", "end": "2020-07-16 20:27:08.876312", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:08.869304", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-07-16T20:27:09.015 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.076) 0:01:27.751 ********* 2020-07-16T20:27:09.029 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T20:27:09.076 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.060) 0:01:27.811 ********* 2020-07-16T20:27:09.078 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:09.092 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-16T20:27:09.095 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.136 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.059) 0:01:27.871 ********* 2020-07-16T20:27:09.147 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-16T20:27:09.149 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.209 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.072) 0:01:27.943 ********* 2020-07-16T20:27:09.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.276 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.335 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.126) 0:01:28.070 ********* 2020-07-16T20:27:09.378 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-16T20:27:09.380 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.437 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.102) 0:01:28.172 ********* 2020-07-16T20:27:09.490 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-07-16T20:27:09.528 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.091) 0:01:28.263 ********* 2020-07-16T20:27:09.585 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-16T20:27:09.587 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.638 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.105) 0:01:28.369 ********* 2020-07-16T20:27:09.679 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T20:27:09.681 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.722 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.089) 0:01:28.458 ********* 2020-07-16T20:27:09.970 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-16T20:27:09.971 INFO:teuthology.task.ansible.out:fatal: [smithi041.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007178", "end": "2020-07-16 20:27:09.948775", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:09.941597", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2020-07-16T20:27:09.972 INFO:teuthology.task.ansible.out:...ignoring 2020-07-16T20:27:10.015 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:10 +0000 (0:00:00.292) 0:01:28.750 ********* 2020-07-16T20:27:10.069 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-16T20:27:10.071 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:10.127 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:10 +0000 (0:00:00.112) 0:01:28.863 ********* 2020-07-16T20:27:11.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T20:27:11.546 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:11 +0000 (0:00:01.417) 0:01:30.281 ********* 2020-07-16T20:27:12.466 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T20:27:12.541 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:12 +0000 (0:00:00.994) 0:01:31.276 ********* 2020-07-16T20:27:13.504 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:27:13.506 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-07-16T20:27:13.548 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:13 +0000 (0:00:01.007) 0:01:32.283 ********* 2020-07-16T20:27:14.716 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-07-16T20:27:14.774 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:14 +0000 (0:00:01.226) 0:01:33.509 ********* 2020-07-16T20:27:16.626 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:16.628 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-07-16T20:27:16.663 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:16 +0000 (0:00:01.888) 0:01:35.398 ********* 2020-07-16T20:27:16.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-16T20:27:16.716 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:16.751 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:16 +0000 (0:00:00.087) 0:01:35.486 ********* 2020-07-16T20:27:17.708 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:27:17.709 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-07-16T20:27:17.753 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:17 +0000 (0:00:01.002) 0:01:36.488 ********* 2020-07-16T20:27:17.802 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:17.803 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:17.844 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:17 +0000 (0:00:00.090) 0:01:36.579 ********* 2020-07-16T20:27:17.855 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:17.856 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-07-16T20:27:17.897 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:17 +0000 (0:00:00.053) 0:01:36.633 ********* 2020-07-16T20:27:17.942 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-16T20:27:17.944 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:17.988 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:17 +0000 (0:00:00.090) 0:01:36.723 ********* 2020-07-16T20:27:18.183 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-07-16T20:27:18.185 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket polkit.service dbus.service basic.target sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ipset.service ip6tables.service ebtables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-07-16T20:27:18.187 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", 2020-07-16T20:27:18.189 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-07-16T20:27:18.191 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T20:27:18.236 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:18 +0000 (0:00:00.248) 0:01:36.972 ********* 2020-07-16T20:27:18.564 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-07-16T20:27:18.566 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-07-16T20:27:18.601 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:18 +0000 (0:00:00.364) 0:01:37.336 ********* 2020-07-16T20:27:19.009 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:27:19.084 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} Thursday 16 July 2020 20:27:19 +0000 (0:00:00.459) 0:01:37.796 ********* 2020-07-16T20:27:19.108 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:19.110 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.149 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.087) 0:01:37.884 ********* 2020-07-16T20:27:19.495 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-07-16T20:27:19.497 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T20:27:19.544 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.395) 0:01:38.279 ********* 2020-07-16T20:27:19.568 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service polkit.service dbus.socket sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service shutdown.target ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-07-16T20:27:19.570 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-07-16T20:27:19.572 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-07-16T20:27:19.574 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T20:27:19.598 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.054) 0:01:38.333 ********* 2020-07-16T20:27:19.608 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-16T20:27:19.610 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.669 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.071) 0:01:38.405 ********* 2020-07-16T20:27:19.711 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-16T20:27:19.713 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.765 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.095) 0:01:38.501 ********* 2020-07-16T20:27:19.808 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-16T20:27:19.810 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.858 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.092) 0:01:38.594 ********* 2020-07-16T20:27:19.910 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-07-16T20:27:19.914 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.968 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.109) 0:01:38.703 ********* 2020-07-16T20:27:19.978 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-07-16T20:27:19.980 INFO:teuthology.task.ansible.out:fatal: [smithi041.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} 2020-07-16T20:27:19.982 INFO:teuthology.task.ansible.out:...ignoring 2020-07-16T20:27:20.030 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.062) 0:01:38.766 ********* 2020-07-16T20:27:20.050 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.104 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.072) 0:01:38.839 ********* 2020-07-16T20:27:20.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-16T20:27:20.151 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.198 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.094) 0:01:38.934 ********* 2020-07-16T20:27:20.248 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-16T20:27:20.300 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.097) 0:01:39.031 ********* 2020-07-16T20:27:20.340 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-07-16T20:27:20.342 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.397 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.100) 0:01:39.132 ********* 2020-07-16T20:27:20.410 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T20:27:20.467 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.070) 0:01:39.202 ********* 2020-07-16T20:27:20.478 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-16T20:27:20.480 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.530 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.062) 0:01:39.265 ********* 2020-07-16T20:27:20.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-16T20:27:20.545 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.586 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.056) 0:01:39.321 ********* 2020-07-16T20:27:20.595 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-16T20:27:20.597 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.598 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.634 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.048) 0:01:39.370 ********* 2020-07-16T20:27:20.643 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-16T20:27:20.645 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.705 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.070) 0:01:39.441 ********* 2020-07-16T20:27:20.719 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-07-16T20:27:20.721 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.760 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.054) 0:01:39.495 ********* 2020-07-16T20:27:20.769 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-16T20:27:20.771 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.053) 0:01:39.548 ********* 2020-07-16T20:27:20.824 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-16T20:27:20.874 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.061) 0:01:39.610 ********* 2020-07-16T20:27:20.885 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-07-16T20:27:20.888 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.923 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.048) 0:01:39.658 ********* 2020-07-16T20:27:20.933 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-16T20:27:20.935 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.973 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.050) 0:01:39.709 ********* 2020-07-16T20:27:20.998 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.038 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.063) 0:01:39.772 ********* 2020-07-16T20:27:21.047 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.083 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.046) 0:01:39.819 ********* 2020-07-16T20:27:21.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-16T20:27:21.097 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.155 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.072) 0:01:39.891 ********* 2020-07-16T20:27:21.165 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-07-16T20:27:21.167 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.202 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.046) 0:01:39.937 ********* 2020-07-16T20:27:21.211 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-16T20:27:21.261 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.058) 0:01:39.996 ********* 2020-07-16T20:27:21.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:21.273 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.320 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.059) 0:01:40.056 ********* 2020-07-16T20:27:21.331 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-07-16T20:27:21.334 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.370 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.050) 0:01:40.106 ********* 2020-07-16T20:27:21.380 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-16T20:27:21.382 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.427 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.056) 0:01:40.163 ********* 2020-07-16T20:27:21.437 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-16T20:27:21.439 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.489 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.061) 0:01:40.224 ********* 2020-07-16T20:27:21.501 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:21.503 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.542 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.053) 0:01:40.277 ********* 2020-07-16T20:27:21.553 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-16T20:27:21.555 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.606 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.063) 0:01:40.341 ********* 2020-07-16T20:27:21.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-16T20:27:21.618 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.654 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.048) 0:01:40.389 ********* 2020-07-16T20:27:21.665 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-07-16T20:27:21.667 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.717 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.063) 0:01:40.452 ********* 2020-07-16T20:27:21.733 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.782 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.064) 0:01:40.517 ********* 2020-07-16T20:27:21.798 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-16T20:27:21.829 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.046) 0:01:40.564 ********* 2020-07-16T20:27:21.839 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-16T20:27:21.841 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.055) 0:01:40.620 ********* 2020-07-16T20:27:21.906 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-16T20:27:21.908 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.954 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.069) 0:01:40.689 ********* 2020-07-16T20:27:21.964 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.001 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.046) 0:01:40.736 ********* 2020-07-16T20:27:22.010 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-07-16T20:27:22.012 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.050 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.048) 0:01:40.785 ********* 2020-07-16T20:27:22.062 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.110 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.060) 0:01:40.845 ********* 2020-07-16T20:27:22.126 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.160 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.050) 0:01:40.895 ********* 2020-07-16T20:27:22.170 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-16T20:27:22.173 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.215 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.054) 0:01:40.950 ********* 2020-07-16T20:27:22.228 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.266 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.050) 0:01:41.001 ********* 2020-07-16T20:27:22.275 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-07-16T20:27:22.277 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.480 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.214) 0:01:41.215 ********* 2020-07-16T20:27:22.489 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-16T20:27:22.491 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.544 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.060) 0:01:41.276 ********* 2020-07-16T20:27:22.553 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.598 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.057) 0:01:41.333 ********* 2020-07-16T20:27:22.608 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:22.610 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.646 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.047) 0:01:41.381 ********* 2020-07-16T20:27:22.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:27:22.658 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.694 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.048) 0:01:41.430 ********* 2020-07-16T20:27:22.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-16T20:27:22.705 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.750 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.055) 0:01:41.485 ********* 2020-07-16T20:27:22.759 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:27:22.761 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.797 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.047) 0:01:41.532 ********* 2020-07-16T20:27:22.807 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-16T20:27:22.809 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.848 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.051) 0:01:41.583 ********* 2020-07-16T20:27:22.857 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:27:22.859 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.899 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.050) 0:01:41.634 ********* 2020-07-16T20:27:22.909 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-16T20:27:22.930 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.963 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.064) 0:01:41.698 ********* 2020-07-16T20:27:22.975 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:27:22.977 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.036 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.072) 0:01:41.771 ********* 2020-07-16T20:27:23.059 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-07-16T20:27:23.061 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.099 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.062) 0:01:41.834 ********* 2020-07-16T20:27:23.110 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:27:23.113 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.162 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.063) 0:01:41.898 ********* 2020-07-16T20:27:23.171 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-07-16T20:27:23.173 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.221 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.058) 0:01:41.956 ********* 2020-07-16T20:27:23.233 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.278 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.057) 0:01:42.014 ********* 2020-07-16T20:27:23.290 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-16T20:27:23.292 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.329 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.050) 0:01:42.064 ********* 2020-07-16T20:27:23.350 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.391 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.061) 0:01:42.125 ********* 2020-07-16T20:27:23.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-07-16T20:27:23.407 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.461 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.070) 0:01:42.196 ********* 2020-07-16T20:27:23.472 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:27:23.474 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.526 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.064) 0:01:42.261 ********* 2020-07-16T20:27:23.542 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-16T20:27:23.544 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.058) 0:01:42.320 ********* 2020-07-16T20:27:23.596 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:23.598 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.640 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.054) 0:01:42.375 ********* 2020-07-16T20:27:23.650 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.688 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.048) 0:01:42.424 ********* 2020-07-16T20:27:23.699 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:27:23.700 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.739 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.049) 0:01:42.474 ********* 2020-07-16T20:27:23.749 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:27:23.750 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.786 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.047) 0:01:42.521 ********* 2020-07-16T20:27:23.797 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:23.799 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.855 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.068) 0:01:42.590 ********* 2020-07-16T20:27:23.879 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.923 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.067) 0:01:42.657 ********* 2020-07-16T20:27:23.940 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.989 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.067) 0:01:42.725 ********* 2020-07-16T20:27:24.006 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.040 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.050) 0:01:42.776 ********* 2020-07-16T20:27:24.061 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:24.063 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.115 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.073) 0:01:42.849 ********* 2020-07-16T20:27:24.125 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.187 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.073) 0:01:42.923 ********* 2020-07-16T20:27:24.234 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:27:24.236 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.097) 0:01:43.020 ********* 2020-07-16T20:27:24.322 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T20:27:24.324 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.363 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.077) 0:01:43.098 ********* 2020-07-16T20:27:24.383 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:24.385 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-07-16T20:27:24.431 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.066) 0:01:43.164 ********* 2020-07-16T20:27:24.438 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:27:24.440 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.479 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.050) 0:01:43.215 ********* 2020-07-16T20:27:24.515 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:24.517 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.565 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.085) 0:01:43.300 ********* 2020-07-16T20:27:24.617 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:27:24.619 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.676 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.111) 0:01:43.412 ********* 2020-07-16T20:27:24.688 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:24.692 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:24.729 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.052) 0:01:43.464 ********* 2020-07-16T20:27:24.744 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:24.750 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.818 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.081) 0:01:43.546 ********* 2020-07-16T20:27:24.863 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:24.865 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:24.908 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.097) 0:01:43.644 ********* 2020-07-16T20:27:24.968 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:24.970 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.011 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.102) 0:01:43.746 ********* 2020-07-16T20:27:25.022 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:25.024 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-07-16T20:27:25.068 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.057) 0:01:43.804 ********* 2020-07-16T20:27:25.120 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:25.122 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.160 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.091) 0:01:43.896 ********* 2020-07-16T20:27:25.202 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T20:27:25.205 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.241 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.080) 0:01:43.976 ********* 2020-07-16T20:27:25.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:25.274 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-07-16T20:27:25.345 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.104) 0:01:44.080 ********* 2020-07-16T20:27:25.361 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:25.363 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.410 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.065) 0:01:44.145 ********* 2020-07-16T20:27:25.465 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:25.467 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.500 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.089) 0:01:44.235 ********* 2020-07-16T20:27:25.544 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:25.546 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.609 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.108) 0:01:44.344 ********* 2020-07-16T20:27:25.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:25.631 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:25.672 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.063) 0:01:44.407 ********* 2020-07-16T20:27:25.686 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.748 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.067) 0:01:44.475 ********* 2020-07-16T20:27:25.818 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.858 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.118) 0:01:44.594 ********* 2020-07-16T20:27:25.890 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:25.892 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:25.941 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.079) 0:01:44.674 ********* 2020-07-16T20:27:25.962 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:25.963 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-07-16T20:27:26.035 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.096) 0:01:44.771 ********* 2020-07-16T20:27:26.048 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:26.050 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.099 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.063) 0:01:44.834 ********* 2020-07-16T20:27:26.109 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:26.111 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.162 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.062) 0:01:44.897 ********* 2020-07-16T20:27:26.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-07-16T20:27:26.175 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.240 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.078) 0:01:44.976 ********* 2020-07-16T20:27:26.252 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T20:27:26.254 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.306 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.063) 0:01:45.039 ********* 2020-07-16T20:27:26.317 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.374 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.069) 0:01:45.109 ********* 2020-07-16T20:27:26.385 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:26.387 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.444 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.070) 0:01:45.179 ********* 2020-07-16T20:27:26.457 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:26.459 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.513 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.068) 0:01:45.248 ********* 2020-07-16T20:27:26.523 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:26.525 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.573 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.060) 0:01:45.308 ********* 2020-07-16T20:27:26.585 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T20:27:26.587 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.632 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.059) 0:01:45.367 ********* 2020-07-16T20:27:26.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:26.647 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.702 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.069) 0:01:45.437 ********* 2020-07-16T20:27:26.713 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-07-16T20:27:26.715 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.765 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.063) 0:01:45.500 ********* 2020-07-16T20:27:26.777 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:26.779 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.831 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.065) 0:01:45.566 ********* 2020-07-16T20:27:26.843 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-16T20:27:26.844 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.883 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.051) 0:01:45.618 ********* 2020-07-16T20:27:26.894 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:26.895 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.943 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.059) 0:01:45.678 ********* 2020-07-16T20:27:26.956 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.011 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.068) 0:01:45.746 ********* 2020-07-16T20:27:27.027 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.067 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.055) 0:01:45.802 ********* 2020-07-16T20:27:27.076 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-16T20:27:27.078 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.115 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.048) 0:01:45.850 ********* 2020-07-16T20:27:27.130 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.166 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.051) 0:01:45.901 ********* 2020-07-16T20:27:27.176 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-16T20:27:27.178 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.223 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.047) 0:01:45.949 ********* 2020-07-16T20:27:27.232 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.288 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.074) 0:01:46.023 ********* 2020-07-16T20:27:27.298 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-16T20:27:27.300 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.344 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.055) 0:01:46.078 ********* 2020-07-16T20:27:27.354 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.403 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.060) 0:01:46.139 ********* 2020-07-16T20:27:27.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-16T20:27:27.414 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.457 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.050) 0:01:46.189 ********* 2020-07-16T20:27:27.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:27.465 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.506 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.051) 0:01:46.241 ********* 2020-07-16T20:27:27.521 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-16T20:27:27.523 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.569 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.063) 0:01:46.305 ********* 2020-07-16T20:27:27.581 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.647 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.075) 0:01:46.380 ********* 2020-07-16T20:27:27.656 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-07-16T20:27:27.662 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.721 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.076) 0:01:46.456 ********* 2020-07-16T20:27:27.738 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.804 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.083) 0:01:46.540 ********* 2020-07-16T20:27:27.821 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T20:27:27.891 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.086) 0:01:46.626 ********* 2020-07-16T20:27:27.904 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-16T20:27:27.906 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.956 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.065) 0:01:46.692 ********* 2020-07-16T20:27:27.981 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-16T20:27:27.983 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.983 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T20:27:28.021 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-07-16T20:27:28.023 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.081 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.124) 0:01:46.816 ********* 2020-07-16T20:27:28.125 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi157.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.176 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.095) 0:01:46.912 ********* 2020-07-16T20:27:28.188 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-16T20:27:28.190 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.248 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.071) 0:01:46.983 ********* 2020-07-16T20:27:28.283 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-16T20:27:28.286 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.337 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.088) 0:01:47.072 ********* 2020-07-16T20:27:28.391 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-16T20:27:28.393 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.459 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.121) 0:01:47.194 ********* 2020-07-16T20:27:28.609 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-16T20:27:28.611 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.017147", "end": "2020-07-16 20:27:28.535759", "rc": 0, "start": "2020-07-16 20:27:28.518612", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.669 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.209) 0:01:47.404 ********* 2020-07-16T20:27:28.746 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.077) 0:01:47.482 ********* 2020-07-16T20:27:28.760 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-16T20:27:28.762 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.802 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.055) 0:01:47.538 ********* 2020-07-16T20:27:28.824 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-16T20:27:28.826 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.082) 0:01:47.621 ********* 2020-07-16T20:27:28.898 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-07-16T20:27:28.899 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.962 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.071) 0:01:47.692 ********* 2020-07-16T20:27:28.970 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.030 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.073) 0:01:47.765 ********* 2020-07-16T20:27:29.040 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:29.043 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T20:27:29.096 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.066) 0:01:47.832 ********* 2020-07-16T20:27:29.109 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-07-16T20:27:29.111 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.149 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.052) 0:01:47.885 ********* 2020-07-16T20:27:29.171 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-16T20:27:29.173 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.183 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T20:27:29.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.234 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.084) 0:01:47.969 ********* 2020-07-16T20:27:29.246 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-16T20:27:29.248 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.249 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.311 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.077) 0:01:48.046 ********* 2020-07-16T20:27:29.629 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-16T20:27:29.631 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.008951", "end": "2020-07-16 20:27:29.581273", "rc": 0, "start": "2020-07-16 20:27:29.572322", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-16T20:27:29.689 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.378) 0:01:48.424 ********* 2020-07-16T20:27:29.751 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-16T20:27:29.753 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.816 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.126) 0:01:48.551 ********* 2020-07-16T20:27:29.883 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.941 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.124) 0:01:48.676 ********* 2020-07-16T20:27:29.994 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-07-16T20:27:29.996 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.053 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.112) 0:01:48.788 ********* 2020-07-16T20:27:30.107 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-16T20:27:30.109 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.147 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.094) 0:01:48.883 ********* 2020-07-16T20:27:30.197 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-16T20:27:30.200 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T20:27:30.250 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.102) 0:01:48.986 ********* 2020-07-16T20:27:30.317 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:30.319 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}} 2020-07-16T20:27:30.373 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.122) 0:01:49.109 ********* 2020-07-16T20:27:30.600 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-16T20:27:30.602 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005188", "end": "2020-07-16 20:27:30.573392", "rc": 0, "start": "2020-07-16 20:27:30.568204", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:30.649 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.275) 0:01:49.384 ********* 2020-07-16T20:27:30.703 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-16T20:27:30.705 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.740 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.091) 0:01:49.475 ********* 2020-07-16T20:27:30.783 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-16T20:27:30.822 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.082) 0:01:49.558 ********* 2020-07-16T20:27:31.149 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-16T20:27:31.151 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T20:27:31.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.363) 0:01:49.922 ********* 2020-07-16T20:27:31.253 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi041.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532057088, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180678, 'block_used': 12914430, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180678, "block_size": 4096, "block_total": 240095108, "block_used": 12914430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532057088, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}} 2020-07-16T20:27:31.289 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.103) 0:01:50.025 ********* 2020-07-16T20:27:31.542 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005348", "end": "2020-07-16 20:27:31.501901", "rc": 0, "start": "2020-07-16 20:27:31.496553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:31.581 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.291) 0:01:50.317 ********* 2020-07-16T20:27:31.658 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-16T20:27:31.660 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532057088, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180678, 'block_used': 12914430, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180678, "block_size": 4096, "block_total": 240095108, "block_used": 12914430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532057088, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.703 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.121) 0:01:50.438 ********* 2020-07-16T20:27:31.745 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-16T20:27:31.786 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.082) 0:01:50.521 ********* 2020-07-16T20:27:32.486 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-16T20:27:32.488 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1benYBdLS7XTfNo5QsCbG9YMsyzjeOiCJg'], 'uuids': ['2d53deb0-11d5-4052-b52b-516d8600e4d6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.405273", "end": "2020-07-16 20:27:32.444152", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1benYBdLS7XTfNo5QsCbG9YMsyzjeOiCJg"], "labels": [], "masters": [], "uuids": ["2d53deb0-11d5-4052-b52b-516d8600e4d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:31.038879", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:33.382 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyPlwiSkuKC4Y3vpVbdTccj1rQ7PDpoeXi'], 'uuids': ['4f2c034f-17f7-439c-9b9a-8d3dd82a551a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.337057", "end": "2020-07-16 20:27:33.342297", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyPlwiSkuKC4Y3vpVbdTccj1rQ7PDpoeXi"], "labels": [], "masters": [], "uuids": ["4f2c034f-17f7-439c-9b9a-8d3dd82a551a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:32.005240", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:33.751 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-6NUUA7-d0Mk-AQ3w-6AdQ-rDxS-slYm-0NYjmw', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN', 'nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.067300", "end": "2020-07-16 20:27:33.717184", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-6NUUA7-d0Mk-AQ3w-6AdQ-rDxS-slYm-0NYjmw", "nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN", "nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:32.649884", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-16T20:27:33.753 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:34.658 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-hIBcPg-4kfW-ppm7-Wz4z-KSnI-D1SG-i9SmDq', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN', 'nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.059785", "end": "2020-07-16 20:27:34.625652", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-hIBcPg-4kfW-ppm7-Wz4z-KSnI-D1SG-i9SmDq", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN", "nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:33.565867", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-16T20:27:34.661 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:35.047 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bxaEYvC0Cn76pvqxO0d1GIEthb7p22bAS'], 'uuids': ['bea9e98f-e81b-400a-bd57-372e547b22b4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.074580", "end": "2020-07-16 20:27:35.004769", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bxaEYvC0Cn76pvqxO0d1GIEthb7p22bAS"], "labels": [], "masters": [], "uuids": ["bea9e98f-e81b-400a-bd57-372e547b22b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:33.930189", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:35.943 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbny4WhlQNSVP0toHpx5geX3NkcKMQgo9F7Q'], 'uuids': ['14a4ba7d-738f-47a7-99d5-6eabeccfb226'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.057881", "end": "2020-07-16 20:27:35.908423", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbny4WhlQNSVP0toHpx5geX3NkcKMQgo9F7Q"], "labels": [], "masters": [], "uuids": ["14a4ba7d-738f-47a7-99d5-6eabeccfb226"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:34.850542", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:36.340 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bYgkylUywRSgXkUTUfOrXoJWEwf6wIzK6'], 'uuids': ['57c9ac0f-41ce-40e4-9dbe-1fc411a68459'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.076737", "end": "2020-07-16 20:27:36.303882", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bYgkylUywRSgXkUTUfOrXoJWEwf6wIzK6"], "labels": [], "masters": [], "uuids": ["57c9ac0f-41ce-40e4-9dbe-1fc411a68459"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:35.227145", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:37.260 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyFHyhavxflw0BF74TycxVtyDKIiLqV24R'], 'uuids': ['58243d44-143e-43d0-94ff-8ff8d266662d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.088480", "end": "2020-07-16 20:27:37.207588", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyFHyhavxflw0BF74TycxVtyDKIiLqV24R"], "labels": [], "masters": [], "uuids": ["58243d44-143e-43d0-94ff-8ff8d266662d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:36.119108", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:37.610 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bVq0nLlBXvEGUdI8aQOIPqwrcVqBGylAX'], 'uuids': ['0f32a319-1727-41ad-93cd-8af3ec8aee7d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.057814", "end": "2020-07-16 20:27:37.579366", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bVq0nLlBXvEGUdI8aQOIPqwrcVqBGylAX"], "labels": [], "masters": [], "uuids": ["0f32a319-1727-41ad-93cd-8af3ec8aee7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:36.521552", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:37.622 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK', 'wwn-0x5000c50092924b2b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092924b2b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'wwn-0x5000c50092924b2b-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, 2020-07-16T20:27:37.625 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:38.523 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyfwphZeWrSveNdP50h1TmTMv1OyWMnobH'], 'uuids': ['6d7d381c-bbdc-42e3-abac-22002ea667f4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.038679", "end": "2020-07-16 20:27:38.467444", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyfwphZeWrSveNdP50h1TmTMv1OyWMnobH"], "labels": [], "masters": [], "uuids": ["6d7d381c-bbdc-42e3-abac-22002ea667f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:37.428765", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:38.536 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S', 'wwn-0x5000c500871a27d9'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HM0S', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a27d9', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1', 'wwn-0x5000c500871a27d9-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S", "wwn-0x5000c500871a27d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1", "wwn-0x5000c500871a27d9-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HM0S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a27d9"}}, 2020-07-16T20:27:38.538 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:38.892 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bTMK0To2swPI6MwVkW0nGy3DRAUHmefV3'], 'uuids': ['8e937465-fb09-419a-aff6-aa6229b24df8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055964", "end": "2020-07-16 20:27:38.855734", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bTMK0To2swPI6MwVkW0nGy3DRAUHmefV3"], "labels": [], "masters": [], "uuids": ["8e937465-fb09-419a-aff6-aa6229b24df8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:37.799770", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:38.933 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:38 +0000 (0:00:07.147) 0:01:57.669 ********* 2020-07-16T20:27:39.336 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:39.338 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1benYBdLS7XTfNo5QsCbG9YMsyzjeOiCJg'], 'uuids': ['2d53deb0-11d5-4052-b52b-516d8600e4d6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140242", "end": "2020-07-16 20:27:39.296388", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1benYBdLS7XTfNo5QsCbG9YMsyzjeOiCJg"], "labels": [], "masters": [], "uuids": ["2d53deb0-11d5-4052-b52b-516d8600e4d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:39.156146", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137488 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137488 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:39.560 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-6NUUA7-d0Mk-AQ3w-6AdQ-rDxS-slYm-0NYjmw', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN', 'nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037338", "end": "2020-07-16 20:27:39.526514", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-6NUUA7-d0Mk-AQ3w-6AdQ-rDxS-slYm-0NYjmw", "nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN", "nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:39.489176", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0346572 s, 3.3 GB/s", "std 2020-07-16T20:27:39.562 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346572 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:39.804 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-16T20:27:39.807 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyv881JIoPEPz5alruNsMAScsqd4czbrkx'], 'uuids': ['5df400e1-2d82-44f3-9503-93ea7994d22c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.052898", "end": "2020-07-16 20:27:39.767764", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyv881JIoPEPz5alruNsMAScsqd4czbrkx"], "labels": [], "masters": [], "uuids": ["5df400e1-2d82-44f3-9503-93ea7994d22c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:38.714866", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:39.869 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:39 +0000 (0:00:00.935) 0:01:58.605 ********* 2020-07-16T20:27:39.903 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:39.905 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bxaEYvC0Cn76pvqxO0d1GIEthb7p22bAS'], 'uuids': ['bea9e98f-e81b-400a-bd57-372e547b22b4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142167", "end": "2020-07-16 20:27:39.874541", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bxaEYvC0Cn76pvqxO0d1GIEthb7p22bAS"], "labels": [], "masters": [], "uuids": ["bea9e98f-e81b-400a-bd57-372e547b22b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:39.732374", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139563 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139563 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:40.258 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bYgkylUywRSgXkUTUfOrXoJWEwf6wIzK6'], 'uuids': ['57c9ac0f-41ce-40e4-9dbe-1fc411a68459'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140158", "end": "2020-07-16 20:27:40.218259", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bYgkylUywRSgXkUTUfOrXoJWEwf6wIzK6"], "labels": [], "masters": [], "uuids": ["57c9ac0f-41ce-40e4-9dbe-1fc411a68459"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.078101", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137605 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137605 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:40.319 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyPlwiSkuKC4Y3vpVbdTccj1rQ7PDpoeXi'], 'uuids': ['4f2c034f-17f7-439c-9b9a-8d3dd82a551a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137888", "end": "2020-07-16 20:27:40.272144", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyPlwiSkuKC4Y3vpVbdTccj1rQ7PDpoeXi"], "labels": [], "masters": [], "uuids": ["4f2c034f-17f7-439c-9b9a-8d3dd82a551a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.134256", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135098 s, 854 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135098 s, 854 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:40.559 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-hIBcPg-4kfW-ppm7-Wz4z-KSnI-D1SG-i9SmDq', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN', 'nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036099", "end": "2020-07-16 20:27:40.521412", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-hIBcPg-4kfW-ppm7-Wz4z-KSnI-D1SG-i9SmDq", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN", "nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.485313", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0334721 s, 3.4 GB/s", "std 2020-07-16T20:27:40.561 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334721 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:40.648 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bVq0nLlBXvEGUdI8aQOIPqwrcVqBGylAX'], 'uuids': ['0f32a319-1727-41ad-93cd-8af3ec8aee7d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141240", "end": "2020-07-16 20:27:40.587297", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bVq0nLlBXvEGUdI8aQOIPqwrcVqBGylAX"], "labels": [], "masters": [], "uuids": ["0f32a319-1727-41ad-93cd-8af3ec8aee7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.446057", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138013 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138013 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:40.669 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK', 'wwn-0x5000c50092924b2b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092924b2b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', 'wwn-0x5000c50092924b2b-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, 2020-07-16T20:27:40.671 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:40.934 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbny4WhlQNSVP0toHpx5geX3NkcKMQgo9F7Q'], 'uuids': ['14a4ba7d-738f-47a7-99d5-6eabeccfb226'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138838", "end": "2020-07-16 20:27:40.878789", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbny4WhlQNSVP0toHpx5geX3NkcKMQgo9F7Q"], "labels": [], "masters": [], "uuids": ["14a4ba7d-738f-47a7-99d5-6eabeccfb226"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.739951", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136229 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136229 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.037 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bTMK0To2swPI6MwVkW0nGy3DRAUHmefV3'], 'uuids': ['8e937465-fb09-419a-aff6-aa6229b24df8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138789", "end": "2020-07-16 20:27:40.997899", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-qkoj8W8appZB2dXTJHnj0iRXUhYSDy1bTMK0To2swPI6MwVkW0nGy3DRAUHmefV3"], "labels": [], "masters": [], "uuids": ["8e937465-fb09-419a-aff6-aa6229b24df8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:40.859110", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136197 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136197 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.086 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:41 +0000 (0:00:01.216) 0:01:59.821 ********* 2020-07-16T20:27:41.279 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyFHyhavxflw0BF74TycxVtyDKIiLqV24R'], 'uuids': ['58243d44-143e-43d0-94ff-8ff8d266662d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.135562", "end": "2020-07-16 20:27:41.239110", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyFHyhavxflw0BF74TycxVtyDKIiLqV24R"], "labels": [], "masters": [], "uuids": ["58243d44-143e-43d0-94ff-8ff8d266662d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:41.103548", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.132874 s, 868 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.132874 s, 868 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.387 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.069699", "end": "2020-07-16 20:27:41.351847", "rc": 0, "start": "2020-07-16 20:27:41.282148", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.429 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:41 +0000 (0:00:00.343) 0:02:00.165 ********* 2020-07-16T20:27:41.623 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:41.625 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyfwphZeWrSveNdP50h1TmTMv1OyWMnobH'], 'uuids': ['6d7d381c-bbdc-42e3-abac-22002ea667f4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.137729", "end": "2020-07-16 20:27:41.592156", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyfwphZeWrSveNdP50h1TmTMv1OyWMnobH"], "labels": [], "masters": [], "uuids": ["6d7d381c-bbdc-42e3-abac-22002ea667f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:41.454427", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135085 s, 854 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135085 s, 854 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.637 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S', 'wwn-0x5000c500871a27d9'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HM0S', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a27d9', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1', 'wwn-0x5000c500871a27d9-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S", "wwn-0x5000c500871a27d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1", "wwn-0x5000c500871a27d9-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HM0S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a27d9"}}, 2020-07-16T20:27:41.640 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:41.703 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T20:27:41.713 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.069891", "end": "2020-07-16 20:27:41.680715", "rc": 0, "start": "2020-07-16 20:27:41.610824", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:41.743 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:41 +0000 (0:00:00.313) 0:02:00.478 ********* 2020-07-16T20:27:41.789 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T20:27:41.838 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:41 +0000 (0:00:00.095) 0:02:00.573 ********* 2020-07-16T20:27:41.881 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-16T20:27:41.883 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:41.921 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:41 +0000 (0:00:00.083) 0:02:00.657 ********* 2020-07-16T20:27:41.956 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.018 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.096) 0:02:00.753 ********* 2020-07-16T20:27:42.032 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:42.034 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyv881JIoPEPz5alruNsMAScsqd4czbrkx'], 'uuids': ['5df400e1-2d82-44f3-9503-93ea7994d22c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.147008", "end": "2020-07-16 20:27:41.953695", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6dHuJYoPZxdDcxMhteDAEvgo1NbUJbnyv881JIoPEPz5alruNsMAScsqd4czbrkx"], "labels": [], "masters": [], "uuids": ["5df400e1-2d82-44f3-9503-93ea7994d22c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:41.806687", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144375 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144375 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:42.079 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.061) 0:02:00.815 ********* 2020-07-16T20:27:42.093 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:42.094 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.139 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.059) 0:02:00.874 ********* 2020-07-16T20:27:42.173 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-16T20:27:42.174 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.238 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.098) 0:02:00.973 ********* 2020-07-16T20:27:42.407 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-07-16T20:27:42.408 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.075637", "end": "2020-07-16 20:27:42.362111", "rc": 0, "start": "2020-07-16 20:27:42.286474", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:42.446 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.208) 0:02:01.182 ********* 2020-07-16T20:27:42.460 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:27:42.505 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.058) 0:02:01.240 ********* 2020-07-16T20:27:42.556 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:42.558 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.595 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.089) 0:02:01.330 ********* 2020-07-16T20:27:42.636 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-16T20:27:42.638 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.679 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.084) 0:02:01.414 ********* 2020-07-16T20:27:42.701 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T20:27:42.702 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043144", "end": "2020-07-16 20:27:42.677903", "rc": 0, "start": "2020-07-16 20:27:42.634759", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:42.741 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.062) 0:02:01.476 ********* 2020-07-16T20:27:42.756 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:42.757 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.804 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.053) 0:02:01.530 ********* 2020-07-16T20:27:42.808 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T20:27:42.848 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.053) 0:02:01.583 ********* 2020-07-16T20:27:42.858 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:42.860 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.899 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.051) 0:02:01.635 ********* 2020-07-16T20:27:42.908 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-07-16T20:27:42.910 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.947 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.047) 0:02:01.682 ********* 2020-07-16T20:27:42.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-16T20:27:42.958 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:42.994 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:42 +0000 (0:00:00.047) 0:02:01.730 ********* 2020-07-16T20:27:43.011 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-07-16T20:27:43.013 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.051 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.056) 0:02:01.786 ********* 2020-07-16T20:27:43.060 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-16T20:27:43.062 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.097 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.046) 0:02:01.833 ********* 2020-07-16T20:27:43.114 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:43.116 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.159 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.061) 0:02:01.895 ********* 2020-07-16T20:27:43.174 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.208 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.048) 0:02:01.943 ********* 2020-07-16T20:27:43.221 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-16T20:27:43.225 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.262 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.054) 0:02:01.997 ********* 2020-07-16T20:27:43.491 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-07-16T20:27:43.492 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:27:43.532 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.269) 0:02:02.267 ********* 2020-07-16T20:27:43.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:43.586 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532057088, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180678, 'block_used': 12914430, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180678, "block_size": 4096, "block_total": 240095108, "block_used": 12914430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532057088, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.632 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.100) 0:02:02.367 ********* 2020-07-16T20:27:43.675 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-16T20:27:43.677 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.721 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.088) 0:02:02.456 ********* 2020-07-16T20:27:43.784 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:43.786 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.837 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.115) 0:02:02.572 ********* 2020-07-16T20:27:43.869 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:43.871 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:43.905 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:43 +0000 (0:00:00.068) 0:02:02.640 ********* 2020-07-16T20:27:43.947 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-16T20:27:43.949 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:44.008 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:44 +0000 (0:00:00.102) 0:02:02.743 ********* 2020-07-16T20:27:44.020 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-07-16T20:27:44.022 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T20:27:44.081 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:44 +0000 (0:00:00.073) 0:02:02.817 ********* 2020-07-16T20:27:44.098 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:44.162 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:44 +0000 (0:00:00.067) 0:02:02.884 ********* 2020-07-16T20:27:44.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:44.238 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:44 +0000 (0:00:00.089) 0:02:02.973 ********* 2020-07-16T20:27:44.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-07-16T20:27:44.733 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T20:27:44.767 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:44 +0000 (0:00:00.529) 0:02:03.502 ********* 2020-07-16T20:27:44.810 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T20:27:44.813 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:45.218 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:45.240 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:45.564 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:45.617 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:45.938 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:46.005 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:46.299 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:46.343 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:46 +0000 (0:00:01.576) 0:02:05.079 ********* 2020-07-16T20:27:46.391 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:46.555 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:46.561 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T20:27:46.606 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:46 +0000 (0:00:00.254) 0:02:05.334 ********* 2020-07-16T20:27:46.751 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:46.796 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:46 +0000 (0:00:00.196) 0:02:05.530 ********* 2020-07-16T20:27:46.861 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:46.863 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.035 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:47.037 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T20:27:47.094 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:47 +0000 (0:00:00.299) 0:02:05.830 ********* 2020-07-16T20:27:47.104 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:47.106 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.247 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.343 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.442 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.466 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:47.551 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:47 +0000 (0:00:00.455) 0:02:06.286 ********* 2020-07-16T20:27:47.564 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.775 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:47.776 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-16T20:27:47.777 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:47.839 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:47 +0000 (0:00:00.288) 0:02:06.574 ********* 2020-07-16T20:27:47.894 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-07-16T20:27:47.896 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-16T20:27:47.957 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:47 +0000 (0:00:00.118) 0:02:06.692 ********* 2020-07-16T20:27:48.004 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:48.006 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:48.027 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:48.073 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:48 +0000 (0:00:00.116) 0:02:06.809 ********* 2020-07-16T20:27:48.337 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-16T20:27:48.340 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:48.381 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:48 +0000 (0:00:00.308) 0:02:07.117 ********* 2020-07-16T20:27:48.438 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-16T20:27:48.483 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:48 +0000 (0:00:00.101) 0:02:07.218 ********* 2020-07-16T20:27:48.673 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi157.front.sepia.ceph.com] => {"changed": true} 2020-07-16T20:27:48.712 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:48 +0000 (0:00:00.229) 0:02:07.447 ********* 2020-07-16T20:27:48.829 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true} 2020-07-16T20:27:48.893 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:48 +0000 (0:00:00.181) 0:02:07.629 ********* 2020-07-16T20:27:49.462 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T20:27:49.464 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T20:27:49.507 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.613) 0:02:08.243 ********* 2020-07-16T20:27:49.537 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T20:27:49.539 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:49.573 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.065) 0:02:08.308 ********* 2020-07-16T20:27:49.604 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-16T20:27:49.606 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:49.640 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.067) 0:02:08.376 ********* 2020-07-16T20:27:49.682 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:49.720 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.079) 0:02:08.455 ********* 2020-07-16T20:27:49.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-07-16T20:27:49.765 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:49.804 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.084) 0:02:08.539 ********* 2020-07-16T20:27:49.848 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:49.850 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:49.890 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.086) 0:02:08.626 ********* 2020-07-16T20:27:49.892 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:49.927 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T20:27:49.929 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.002 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:49 +0000 (0:00:00.110) 0:02:08.737 ********* 2020-07-16T20:27:50.032 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T20:27:50.035 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.086 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.084) 0:02:08.821 ********* 2020-07-16T20:27:50.125 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.173 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.087) 0:02:08.909 ********* 2020-07-16T20:27:50.204 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-16T20:27:50.206 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.243 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.069) 0:02:08.979 ********* 2020-07-16T20:27:50.283 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-16T20:27:50.285 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.327 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.083) 0:02:09.063 ********* 2020-07-16T20:27:50.357 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-16T20:27:50.359 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.067) 0:02:09.130 ********* 2020-07-16T20:27:50.480 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T20:27:50.482 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T20:27:50.525 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.131) 0:02:09.261 ********* 2020-07-16T20:27:50.569 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T20:27:50.571 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.634 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.108) 0:02:09.370 ********* 2020-07-16T20:27:50.677 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-16T20:27:50.679 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.714 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.080) 0:02:09.450 ********* 2020-07-16T20:27:50.757 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-16T20:27:50.759 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.811 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.096) 0:02:09.546 ********* 2020-07-16T20:27:50.857 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-07-16T20:27:50.859 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.897 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.086) 0:02:09.633 ********* 2020-07-16T20:27:50.931 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-16T20:27:50.933 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:50.972 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:50 +0000 (0:00:00.074) 0:02:09.707 ********* 2020-07-16T20:27:51.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T20:27:51.049 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.077) 0:02:09.785 ********* 2020-07-16T20:27:51.060 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T20:27:51.063 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.102 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.053) 0:02:09.838 ********* 2020-07-16T20:27:51.159 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T20:27:51.162 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.206 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.103) 0:02:09.941 ********* 2020-07-16T20:27:51.251 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-16T20:27:51.253 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.303 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.088) 0:02:10.029 ********* 2020-07-16T20:27:51.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.376 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.082) 0:02:10.112 ********* 2020-07-16T20:27:51.422 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:41 UTC", "ActiveEnterTimestampMonotonic": "15839792", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount ntpd.service systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target basic.target ntpdate.service sntp.service tmp.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:39 UTC", "AssertTimestampMonotonic": "14714765", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:39 UTC", "ConditionTimestampMonotonic": "14714744", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.servic 2020-07-16T20:27:51.424 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2451", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:41 UTC", "ExecMainStartTimestampMonotonic": "15792683", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:40 UTC] ; stop_time=[Thu 2020-07-16 20:24:41 UTC] ; pid=2430 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:41 UTC] ; stop_time=[Thu 2020-07-16 20:24:41 UTC] ; pid=2480 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:40 UTC", "InactiveExitTimestampMonotonic": "14789252", "InvocationID": "b9fd268627144830b17c704edbb19f1d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitD 2020-07-16T20:27:51.430 INFO:teuthology.task.ansible.out:ATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2451", "MemoryAccounting": "yes", "MemoryCurrent": "2736128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "Run 2020-07-16T20:27:51.432 INFO:teuthology.task.ansible.out:timeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:41 UTC", "StateChangeTimestampMonotonic": "15839792", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:41 UTC", "WatchdogTimestampMonotonic": "15792697", "WatchdogUSec": "0"}} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.469 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.092) 0:02:10.204 ********* 2020-07-16T20:27:51.512 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.042) 0:02:10.247 ********* 2020-07-16T20:27:51.522 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-16T20:27:51.524 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.561 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.049) 0:02:10.296 ********* 2020-07-16T20:27:51.571 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:51.573 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T20:27:51.616 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.055) 0:02:10.352 ********* 2020-07-16T20:27:51.667 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:51.669 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T20:27:51.705 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.088) 0:02:10.440 ********* 2020-07-16T20:27:51.743 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-16T20:27:51.745 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.802 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.097) 0:02:10.538 ********* 2020-07-16T20:27:51.844 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-16T20:27:51.846 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.886 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.083) 0:02:10.621 ********* 2020-07-16T20:27:51.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T20:27:51.929 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:51.966 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:51 +0000 (0:00:00.080) 0:02:10.701 ********* 2020-07-16T20:27:52.137 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-16T20:27:52.139 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T20:27:52.174 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.207) 0:02:10.909 ********* 2020-07-16T20:27:52.216 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-16T20:27:52.218 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T20:27:52.264 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.090) 0:02:11.000 ********* 2020-07-16T20:27:52.527 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-16T20:27:52.529 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:23:56 UTC", "ActiveEnterTimestampMonotonic": "19577249", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount ntpd.service sntp.service tmp.mount ntpdate.service systemd-journald.socket system.slice sysinit.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:23:55 UTC", "AssertTimestampMonotonic": "18356575", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:23:55 UTC", "ConditionTimestampMonotonic": "18356541", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-07-16T20:27:52.530 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2438", "ExecMainStartTimestamp": "Thu 2020-07-16 20:23:56 UTC", "ExecMainStartTimestampMonotonic": "19492948", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:23:55 UTC] ; stop_time=[Thu 2020-07-16 20:23:56 UTC] ; pid=2431 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:23:56 UTC] ; stop_time=[Thu 2020-07-16 20:23:56 UTC] ; pid=2491 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:23:55 UTC", "InactiveExitTimestampMonotonic": "18466991", "InvocationID": "9eb4301fd3994cd28e16624cc4df5df9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZE 2020-07-16T20:27:52.532 INFO:teuthology.task.ansible.out:Soft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2438", "MemoryAccounting": "yes", "MemoryCurrent": "2805760", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no" 2020-07-16T20:27:52.534 INFO:teuthology.task.ansible.out:, "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:23:56 UTC", "StateChangeTimestampMonotonic": "19577249", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:23:56 UTC", "WatchdogTimestampMonotonic": "19492963", "WatchdogUSec": "0"}} 2020-07-16T20:27:52.573 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.308) 0:02:11.308 ********* 2020-07-16T20:27:52.616 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:52.618 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T20:27:52.663 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.090) 0:02:11.399 ********* 2020-07-16T20:27:52.710 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T20:27:52.753 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.090) 0:02:11.489 ********* 2020-07-16T20:27:52.797 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-16T20:27:52.802 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:52.854 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.100) 0:02:11.589 ********* 2020-07-16T20:27:52.897 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.043) 0:02:11.632 ********* 2020-07-16T20:27:52.908 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-16T20:27:52.910 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:52.949 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:52 +0000 (0:00:00.051) 0:02:11.684 ********* 2020-07-16T20:27:52.979 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T20:27:52.981 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:53.046 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:53 +0000 (0:00:00.096) 0:02:11.781 ********* 2020-07-16T20:27:53.299 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-16T20:27:53.301 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T20:27:53.368 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:53 +0000 (0:00:00.321) 0:02:12.103 ********* 2020-07-16T20:27:53.928 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-16T20:27:53.930 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-07-16T20:27:53.988 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:53 +0000 (0:00:00.620) 0:02:12.724 ********* 2020-07-16T20:27:54.302 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-07-16T20:27:54.304 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T20:27:54.345 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.356) 0:02:13.080 ********* 2020-07-16T20:27:54.387 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T20:27:54.389 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:54.425 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.079) 0:02:13.160 ********* 2020-07-16T20:27:54.478 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-16T20:27:54.532 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.107) 0:02:13.267 ********* 2020-07-16T20:27:54.741 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T20:27:54.743 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-07-16T20:27:54.789 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.257) 0:02:13.524 ********* 2020-07-16T20:27:54.824 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-16T20:27:54.826 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:54.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.095) 0:02:13.620 ********* 2020-07-16T20:27:54.940 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-16T20:27:54.942 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T20:27:54.992 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:54 +0000 (0:00:00.106) 0:02:13.727 ********* 2020-07-16T20:27:55.026 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-07-16T20:27:55.028 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.075 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.082) 0:02:13.809 ********* 2020-07-16T20:27:55.134 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-07-16T20:27:55.136 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T20:27:55.180 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.106) 0:02:13.916 ********* 2020-07-16T20:27:55.239 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T20:27:55.241 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.103) 0:02:14.019 ********* 2020-07-16T20:27:55.307 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-16T20:27:55.310 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T20:27:55.359 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.075) 0:02:14.094 ********* 2020-07-16T20:27:55.374 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-07-16T20:27:55.413 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.054) 0:02:14.149 ********* 2020-07-16T20:27:55.573 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-07-16T20:27:55.575 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T20:27:55.610 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.196) 0:02:14.345 ********* 2020-07-16T20:27:55.640 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T20:27:55.643 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.675 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.065) 0:02:14.411 ********* 2020-07-16T20:27:55.722 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.046) 0:02:14.458 ********* 2020-07-16T20:27:55.733 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-16T20:27:55.735 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.771 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.049) 0:02:14.507 ********* 2020-07-16T20:27:55.787 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T20:27:55.789 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.800 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.837 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.065) 0:02:14.572 ********* 2020-07-16T20:27:55.847 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T20:27:55.906 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.069) 0:02:14.641 ********* 2020-07-16T20:27:55.916 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T20:27:55.918 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.928 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.931 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:55.989 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:55 +0000 (0:00:00.083) 0:02:14.724 ********* 2020-07-16T20:27:55.999 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-07-16T20:27:56.001 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.036 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.046) 0:02:14.771 ********* 2020-07-16T20:27:56.047 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.089 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.052) 0:02:14.824 ********* 2020-07-16T20:27:56.130 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-16T20:27:56.132 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.184 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.095) 0:02:14.919 ********* 2020-07-16T20:27:56.220 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-16T20:27:56.222 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.274 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.090) 0:02:15.009 ********* 2020-07-16T20:27:56.286 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-16T20:27:56.288 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T20:27:56.330 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.055) 0:02:15.065 ********* 2020-07-16T20:27:56.339 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-16T20:27:56.342 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.379 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.048) 0:02:15.114 ********* 2020-07-16T20:27:56.433 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-07-16T20:27:56.434 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.478 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.099) 0:02:15.214 ********* 2020-07-16T20:27:56.514 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:56.515 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.559 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.080) 0:02:15.294 ********* 2020-07-16T20:27:56.572 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-07-16T20:27:56.574 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T20:27:56.616 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.056) 0:02:15.351 ********* 2020-07-16T20:27:56.630 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-16T20:27:56.632 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.681 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.065) 0:02:15.417 ********* 2020-07-16T20:27:56.691 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.736 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.054) 0:02:15.471 ********* 2020-07-16T20:27:56.745 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:56.747 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.785 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.046) 0:02:15.518 ********* 2020-07-16T20:27:56.792 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T20:27:56.797 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.804 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.807 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.851 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.067) 0:02:15.586 ********* 2020-07-16T20:27:56.899 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T20:27:56.900 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.921 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.922 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.924 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.935 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:56.988 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:56 +0000 (0:00:00.137) 0:02:15.723 ********* 2020-07-16T20:27:57.028 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:57.030 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.086 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.097) 0:02:15.821 ********* 2020-07-16T20:27:57.135 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-16T20:27:57.137 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.170 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.084) 0:02:15.906 ********* 2020-07-16T20:27:57.202 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-16T20:27:57.203 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.261 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.090) 0:02:15.996 ********* 2020-07-16T20:27:57.301 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-16T20:27:57.303 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.337 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.076) 0:02:16.072 ********* 2020-07-16T20:27:57.367 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-07-16T20:27:57.370 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.412 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.074) 0:02:16.147 ********* 2020-07-16T20:27:57.466 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.535 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.122) 0:02:16.270 ********* 2020-07-16T20:27:57.582 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.618 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.083) 0:02:16.354 ********* 2020-07-16T20:27:57.659 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:57.662 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:57.696 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:57 +0000 (0:00:00.077) 0:02:16.431 ********* 2020-07-16T20:27:57.971 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T20:27:57.974 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005280", "end": "2020-07-16 20:27:57.927376", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 20:27:57.922096", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.043 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006165", "end": "2020-07-16 20:27:57.987072", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 20:27:56.980907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.194 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003146", "end": "2020-07-16 20:27:58.151936", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 20:27:58.148790", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.276 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003046", "end": "2020-07-16 20:27:58.225068", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 20:27:58.222022", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.402 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002837", "end": "2020-07-16 20:27:58.365127", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:58.362290", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.489 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002748", "end": "2020-07-16 20:27:58.440919", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:58.438171", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.628 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024862", "end": "2020-07-16 20:27:58.589982", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 20:27:58.565120", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.691 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:58 +0000 (0:00:00.995) 0:02:17.427 ********* 2020-07-16T20:27:58.710 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.012189", "end": "2020-07-16 20:27:58.657569", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 20:27:58.645380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:58.766 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:58 +0000 (0:00:00.074) 0:02:17.501 ********* 2020-07-16T20:27:58.779 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-16T20:27:58.843 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:58 +0000 (0:00:00.076) 0:02:17.578 ********* 2020-07-16T20:27:58.897 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:58 +0000 (0:00:00.054) 0:02:17.633 ********* 2020-07-16T20:27:59.062 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-16T20:27:59.064 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:59.181 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:59.289 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-07-16T20:27:59.295 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-07-16T20:27:59.296 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-07-16T20:27:59.299 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi041.front.sepia.ceph.com : ok=111 changed=30 unreachable=0 failed=0 skipped=178 rescued=0 ignored=3 smithi157.front.sepia.ceph.com : ok=111 changed=30 unreachable=0 failed=0 skipped=178 rescued=0 ignored=3 Thursday 16 July 2020 20:27:59 +0000 (0:00:00.401) 0:02:18.034 ********* =============================================================================== 2020-07-16T20:27:59.301 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.56s common : nrpe - Load SELinux policy package ---------------------------- 16.00s testnode : Zap all non-root disks --------------------------------------- 7.15s Gathering Facts --------------------------------------------------------- 1.94s testnode : Install packages --------------------------------------------- 1.89s testnode : Create logical volume(s) ------------------------------------- 1.58s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.53s testnode : Ensure ceph packages are not present. ------------------------ 1.42s testnode : Rebuild rpmdb ------------------------------------------------ 1.40s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.39s common : Install Kerberos Packages (RedHat) ----------------------------- 1.36s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.34s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.22s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.15s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.15s common : Configure local epel mirrorlists ------------------------------- 1.11s testnode : Ensure ceph dependency packages are not present. ------------- 1.01s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.00s testnode : Configure local mirrorlists ---------------------------------- 0.99s common : Set the hardware clock ----------------------------------------- 0.94s 2020-07-16T20:27:59.705 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi041.front.sepia.ceph.com')] 2020-07-16T20:27:59.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:27:59.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:27:59.801 INFO:teuthology.orchestra.run.smithi157:> true 2020-07-16T20:27:59.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:27:59.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:27:59.992 INFO:teuthology.orchestra.run.smithi041:> true 2020-07-16T20:28:00.099 INFO:teuthology.run_tasks:Running task clock... 2020-07-16T20:28:00.125 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-07-16T20:28:00.126 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T20:28:00.127 INFO:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T20:28:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T20:28:00.183 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T20:28:00.230 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2020-07-16T20:28:00.246 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2020-07-16T20:28:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T20:28:00.282 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T20:28:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2020-07-16T20:28:00.338 INFO:teuthology.orchestra.run.smithi157.stdout:210 Number of sources = 4 2020-07-16T20:28:00.339 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T20:28:00.339 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2020-07-16T20:28:00.340 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.340 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.340 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.341 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.341 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T20:28:00.342 INFO:teuthology.orchestra.run.smithi041:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T20:28:00.387 INFO:teuthology.orchestra.run.smithi041.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T20:28:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T20:28:00.459 INFO:teuthology.orchestra.run.smithi041.stderr:sudo: ntpd: command not found 2020-07-16T20:28:00.476 INFO:teuthology.orchestra.run.smithi041.stdout:506 Cannot talk to daemon 2020-07-16T20:28:00.498 INFO:teuthology.orchestra.run.smithi041.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T20:28:00.519 INFO:teuthology.orchestra.run.smithi041.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T20:28:00.585 INFO:teuthology.orchestra.run.smithi041.stderr:bash: ntpq: command not found 2020-07-16T20:28:00.587 INFO:teuthology.orchestra.run.smithi041.stdout:210 Number of sources = 4 2020-07-16T20:28:00.588 INFO:teuthology.orchestra.run.smithi041.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T20:28:00.588 INFO:teuthology.orchestra.run.smithi041.stdout:=============================================================================== 2020-07-16T20:28:00.588 INFO:teuthology.orchestra.run.smithi041.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.589 INFO:teuthology.orchestra.run.smithi041.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.589 INFO:teuthology.orchestra.run.smithi041.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.589 INFO:teuthology.orchestra.run.smithi041.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:28:00.590 INFO:teuthology.run_tasks:Running task install... 2020-07-16T20:28:00.603 DEBUG:teuthology.task.install:project ceph 2020-07-16T20:28:00.604 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}} 2020-07-16T20:28:00.605 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'} 2020-07-16T20:28:00.605 INFO:teuthology.task.install:Using flavor: basic 2020-07-16T20:28:00.615 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-07-16T20:28:00.616 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-07-16T20:28:00.616 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-07-16T20:28:00.653 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2020-07-16T20:28:00.655 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:28:00.656 INFO:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2020-07-16T20:28:00.657 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-07-16T20:28:00.658 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-07-16T20:28:00.699 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS 2020-07-16T20:28:00.700 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:28:00.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-07-16T20:28:00.701 INFO:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2020-07-16T20:28:00.732 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2020-07-16T20:28:00.734 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:28:00.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:28:00.789 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS 2020-07-16T20:28:00.790 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:28:00.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:28:00.931 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/ 2020-07-16T20:28:00.931 INFO:teuthology.task.install.rpm:Package version is 16.0.0-3565.g8e60ca350a5 2020-07-16T20:28:00.974 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/ 2020-07-16T20:28:00.975 INFO:teuthology.task.install.rpm:Package version is 16.0.0-3565.g8e60ca350a5 2020-07-16T20:28:01.222 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-07-16T20:28:01.223 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-07-16T20:28:01.245 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-07-16T20:28:01.246 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-07-16T20:28:01.270 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-07-16T20:28:01.271 INFO:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-07-16T20:28:01.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-07-16T20:28:01.301 INFO:teuthology.orchestra.run.smithi041:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-07-16T20:28:01.340 INFO:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-07-16T20:28:01.375 INFO:teuthology.orchestra.run.smithi041:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-07-16T20:28:01.422 INFO:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-07-16T20:28:01.474 INFO:teuthology.orchestra.run.smithi041:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-07-16T20:28:01.489 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2020-07-16T20:28:01.491 INFO:teuthology.orchestra.run.smithi157:> sudo yum clean all 2020-07-16T20:28:01.505 INFO:teuthology.orchestra.run.smithi041.stdout:check_obsoletes = 1 2020-07-16T20:28:01.506 INFO:teuthology.orchestra.run.smithi041:> sudo yum clean all 2020-07-16T20:28:01.768 INFO:teuthology.orchestra.run.smithi157.stdout:41 files removed 2020-07-16T20:28:01.797 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-07-16T20:28:01.805 INFO:teuthology.orchestra.run.smithi041.stdout:41 files removed 2020-07-16T20:28:01.835 INFO:teuthology.orchestra.run.smithi041:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-07-16T20:28:02.790 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 111 kB/s | 71 kB 00:00 2020-07-16T20:28:02.860 INFO:teuthology.orchestra.run.smithi041.stdout:ceph packages for x86_64 111 kB/s | 71 kB 00:00 2020-07-16T20:28:03.354 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 27 kB/s | 15 kB 00:00 2020-07-16T20:28:03.418 INFO:teuthology.orchestra.run.smithi041.stdout:ceph noarch packages 27 kB/s | 15 kB 00:00 2020-07-16T20:28:03.920 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 2.6 kB/s | 1.4 kB 00:00 2020-07-16T20:28:03.990 INFO:teuthology.orchestra.run.smithi041.stdout:ceph source packages 2.6 kB/s | 1.4 kB 00:00 2020-07-16T20:28:04.090 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - AppStream 49 MB/s | 7.0 MB 00:00 2020-07-16T20:28:04.179 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - AppStream 42 MB/s | 7.0 MB 00:00 2020-07-16T20:28:05.268 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:28:05.506 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:28:05.688 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-8 - Extras 89 kB/s | 5.5 kB 00:00 2020-07-16T20:28:05.957 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS-8 - Extras 86 kB/s | 5.5 kB 00:00 2020-07-16T20:28:06.058 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T20:28:06.316 INFO:teuthology.orchestra.run.smithi041.stdout:Extra Packages for Enterprise Linux 24 MB/s | 7.4 MB 00:00 2020-07-16T20:28:07.591 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 4.2 MB/s | 20 kB 00:00 2020-07-16T20:28:07.934 INFO:teuthology.orchestra.run.smithi041.stdout:lab-extras 3.8 MB/s | 20 kB 00:00 2020-07-16T20:28:08.443 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:28:08.444 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:28:08.447 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-07-16T20:28:08.448 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-07-16T20:28:08.448 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-07-16T20:28:08.448 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-07-16T20:28:08.449 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-07-16T20:28:08.450 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-07-16T20:28:08.450 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-07-16T20:28:08.576 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-07-16T20:28:08.603 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-07-16T20:28:08.604 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-07-16T20:28:08.604 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-07-16T20:28:08.605 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-07-16T20:28:08.605 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.5 k 2020-07-16T20:28:08.605 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.0 M 2020-07-16T20:28:08.606 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 604 k 2020-07-16T20:28:08.606 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 202 k 2020-07-16T20:28:08.606 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 1.5 M 2020-07-16T20:28:08.607 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 10 M 2020-07-16T20:28:08.607 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 45 M 2020-07-16T20:28:08.607 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 48 k 2020-07-16T20:28:08.608 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 23 k 2020-07-16T20:28:08.608 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 536 k 2020-07-16T20:28:08.608 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 131 k 2020-07-16T20:28:08.609 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 204 k 2020-07-16T20:28:08.609 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 364 k 2020-07-16T20:28:08.609 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 335 k 2020-07-16T20:28:08.618 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 113 k 2020-07-16T20:28:08.618 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 87 k 2020-07-16T20:28:08.618 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.7 M 2020-07-16T20:28:08.619 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 161 k 2020-07-16T20:28:08.619 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 54 k 2020-07-16T20:28:08.619 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 3.5 M 2020-07-16T20:28:08.620 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.6 M 2020-07-16T20:28:08.620 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 27 k 2020-07-16T20:28:08.620 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-07-16T20:28:08.621 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-07-16T20:28:08.621 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-07-16T20:28:08.621 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-07-16T20:28:08.622 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-07-16T20:28:08.622 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-07-16T20:28:08.623 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-07-16T20:28:08.623 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-07-16T20:28:08.623 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2020-07-16T20:28:08.624 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.7 M 2020-07-16T20:28:08.624 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.0 M 2020-07-16T20:28:08.624 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-07-16T20:28:08.625 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-07-16T20:28:08.625 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-07-16T20:28:08.625 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-07-16T20:28:08.626 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-07-16T20:28:08.626 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 22 M 2020-07-16T20:28:08.630 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.1 M 2020-07-16T20:28:08.630 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 4.9 M 2020-07-16T20:28:08.631 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 18 M 2020-07-16T20:28:08.631 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 25 k 2020-07-16T20:28:08.631 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 484 k 2020-07-16T20:28:08.631 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.4 M 2020-07-16T20:28:08.632 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 40 k 2020-07-16T20:28:08.632 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 67 k 2020-07-16T20:28:08.632 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 24 k 2020-07-16T20:28:08.632 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 174 k 2020-07-16T20:28:08.633 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.8 k 2020-07-16T20:28:08.633 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-07-16T20:28:08.633 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-07-16T20:28:08.633 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-07-16T20:28:08.634 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-07-16T20:28:08.634 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-07-16T20:28:08.634 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-07-16T20:28:08.634 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-07-16T20:28:08.635 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-07-16T20:28:08.635 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-07-16T20:28:08.635 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-07-16T20:28:08.635 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-07-16T20:28:08.635 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-07-16T20:28:08.636 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-07-16T20:28:08.637 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-07-16T20:28:08.637 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-07-16T20:28:08.637 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-07-16T20:28:08.637 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-07-16T20:28:08.638 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-07-16T20:28:08.638 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-07-16T20:28:08.638 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-07-16T20:28:08.638 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-07-16T20:28:08.638 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-07-16T20:28:08.639 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-07-16T20:28:08.639 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-07-16T20:28:08.639 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-07-16T20:28:08.639 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-07-16T20:28:08.639 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-07-16T20:28:08.640 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-07-16T20:28:08.640 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-07-16T20:28:08.640 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-07-16T20:28:08.640 INFO:teuthology.orchestra.run.smithi157.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-07-16T20:28:08.640 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-07-16T20:28:08.641 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-07-16T20:28:08.641 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-07-16T20:28:08.641 INFO:teuthology.orchestra.run.smithi157.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-07-16T20:28:08.641 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-07-16T20:28:08.641 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-07-16T20:28:08.642 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-07-16T20:28:08.642 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-07-16T20:28:08.642 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-07-16T20:28:08.643 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-07-16T20:28:08.643 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-07-16T20:28:08.643 INFO:teuthology.orchestra.run.smithi157.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-07-16T20:28:08.643 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-07-16T20:28:08.644 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-07-16T20:28:08.644 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-07-16T20:28:08.644 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-07-16T20:28:08.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-07-16T20:28:08.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-07-16T20:28:08.645 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-07-16T20:28:08.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-07-16T20:28:08.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-07-16T20:28:08.646 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-07-16T20:28:08.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-07-16T20:28:08.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-07-16T20:28:08.647 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-07-16T20:28:08.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-07-16T20:28:08.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-07-16T20:28:08.648 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-07-16T20:28:08.649 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-07-16T20:28:08.649 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-07-16T20:28:08.649 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-07-16T20:28:08.650 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-07-16T20:28:08.650 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-07-16T20:28:08.650 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-07-16T20:28:08.651 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-07-16T20:28:08.651 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-07-16T20:28:08.652 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-07-16T20:28:08.652 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-07-16T20:28:08.652 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-07-16T20:28:08.652 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch0.5.2-4.el8 epel 26 k 2020-07-16T20:28:08.653 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-07-16T20:28:08.653 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-07-16T20:28:08.654 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-07-16T20:28:08.654 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-07-16T20:28:08.654 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-07-16T20:28:08.654 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-07-16T20:28:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2020-07-16T20:28:08.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-07-16T20:28:08.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-07-16T20:28:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:Downgrading: 2020-07-16T20:28:08.655 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-07-16T20:28:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-07-16T20:28:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-07-16T20:28:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-07-16T20:28:08.656 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-07-16T20:28:08.657 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:28:08.657 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-07-16T20:28:08.657 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-07-16T20:28:08.658 INFO:teuthology.orchestra.run.smithi157.stdout:Install 126 Packages 2020-07-16T20:28:08.658 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 6 Packages 2020-07-16T20:28:08.658 INFO:teuthology.orchestra.run.smithi157.stdout:Downgrade 5 Packages 2020-07-16T20:28:08.659 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:28:08.659 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 195 M 2020-07-16T20:28:08.660 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-07-16T20:28:08.660 INFO:teuthology.orchestra.run.smithi157.stdout:(1/137): libkadm5-1.17-9.el8.x86_64.rpm 4.0 MB/s | 184 kB 00:00 2020-07-16T20:28:08.662 INFO:teuthology.orchestra.run.smithi157.stdout:(2/137): krb5-workstation-1.17-9.el8.x86_64.rpm 19 MB/s | 940 kB 00:00 2020-07-16T20:28:08.678 INFO:teuthology.orchestra.run.smithi157.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 35 MB/s | 686 kB 00:00 2020-07-16T20:28:08.694 INFO:teuthology.orchestra.run.smithi157.stdout:(4/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 47 MB/s | 1.5 MB 00:00 2020-07-16T20:28:08.696 INFO:teuthology.orchestra.run.smithi157.stdout:(5/137): krb5-libs-1.17-9.el8.x86_64.rpm 10 MB/s | 851 kB 00:00 2020-07-16T20:28:08.778 INFO:teuthology.orchestra.run.smithi157.stdout:(6/137): ceph-16.0.0-3565.g8e60ca350a5.el8.x86_ 65 kB/s | 6.5 kB 00:00 2020-07-16T20:28:08.865 INFO:teuthology.orchestra.run.smithi041.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:28:08.866 INFO:teuthology.orchestra.run.smithi041.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:28:08.869 INFO:teuthology.orchestra.run.smithi041.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-07-16T20:28:08.869 INFO:teuthology.orchestra.run.smithi041.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-07-16T20:28:08.870 INFO:teuthology.orchestra.run.smithi041.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-07-16T20:28:08.870 INFO:teuthology.orchestra.run.smithi041.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-07-16T20:28:08.871 INFO:teuthology.orchestra.run.smithi041.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-07-16T20:28:08.872 INFO:teuthology.orchestra.run.smithi041.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-07-16T20:28:08.872 INFO:teuthology.orchestra.run.smithi041.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-07-16T20:28:08.898 INFO:teuthology.orchestra.run.smithi157.stdout:(7/137): ceph-fuse-16.0.0-3565.g8e60ca350a5.el8 4.9 MB/s | 604 kB 00:00 2020-07-16T20:28:08.928 INFO:teuthology.orchestra.run.smithi157.stdout:(8/137): ceph-immutable-object-cache-16.0.0-356 6.6 MB/s | 202 kB 00:00 2020-07-16T20:28:09.010 INFO:teuthology.orchestra.run.smithi041.stdout:Dependencies resolved. 2020-07-16T20:28:09.036 INFO:teuthology.orchestra.run.smithi041.stdout:================================================================================ 2020-07-16T20:28:09.036 INFO:teuthology.orchestra.run.smithi041.stdout: Package ArchVersion Repository Size 2020-07-16T20:28:09.037 INFO:teuthology.orchestra.run.smithi041.stdout:================================================================================ 2020-07-16T20:28:09.038 INFO:teuthology.orchestra.run.smithi041.stdout:Installing: 2020-07-16T20:28:09.038 INFO:teuthology.orchestra.run.smithi041.stdout: ceph x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.5 k 2020-07-16T20:28:09.038 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-base x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.0 M 2020-07-16T20:28:09.039 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 604 k 2020-07-16T20:28:09.039 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-immutable-object-cache x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 202 k 2020-07-16T20:28:09.039 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 1.5 M 2020-07-16T20:28:09.040 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-radosgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 10 M 2020-07-16T20:28:09.040 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-test x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 45 M 2020-07-16T20:28:09.040 INFO:teuthology.orchestra.run.smithi041.stdout: cephadm x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 48 k 2020-07-16T20:28:09.041 INFO:teuthology.orchestra.run.smithi041.stdout: libcephfs-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 23 k 2020-07-16T20:28:09.041 INFO:teuthology.orchestra.run.smithi041.stdout: libcephfs2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 536 k 2020-07-16T20:28:09.041 INFO:teuthology.orchestra.run.smithi041.stdout: librados-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 131 k 2020-07-16T20:28:09.042 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cephfs x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 204 k 2020-07-16T20:28:09.043 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rados x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 364 k 2020-07-16T20:28:09.044 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 335 k 2020-07-16T20:28:09.044 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 113 k 2020-07-16T20:28:09.044 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 87 k 2020-07-16T20:28:09.045 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-mirror x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.7 M 2020-07-16T20:28:09.045 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-nbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 161 k 2020-07-16T20:28:09.045 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-cephadm noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 54 k 2020-07-16T20:28:09.046 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-dashboard noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 3.5 M 2020-07-16T20:28:09.046 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.6 M 2020-07-16T20:28:09.046 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-rook noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 27 k 2020-07-16T20:28:09.047 INFO:teuthology.orchestra.run.smithi041.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-07-16T20:28:09.047 INFO:teuthology.orchestra.run.smithi041.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-07-16T20:28:09.047 INFO:teuthology.orchestra.run.smithi041.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-07-16T20:28:09.048 INFO:teuthology.orchestra.run.smithi041.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-07-16T20:28:09.049 INFO:teuthology.orchestra.run.smithi041.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-07-16T20:28:09.049 INFO:teuthology.orchestra.run.smithi041.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-07-16T20:28:09.049 INFO:teuthology.orchestra.run.smithi041.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-07-16T20:28:09.050 INFO:teuthology.orchestra.run.smithi041.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-07-16T20:28:09.050 INFO:teuthology.orchestra.run.smithi041.stdout:Upgrading: 2020-07-16T20:28:09.050 INFO:teuthology.orchestra.run.smithi041.stdout: librados2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.7 M 2020-07-16T20:28:09.051 INFO:teuthology.orchestra.run.smithi041.stdout: librbd1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.0 M 2020-07-16T20:28:09.051 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-07-16T20:28:09.051 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-07-16T20:28:09.052 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-07-16T20:28:09.052 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-07-16T20:28:09.052 INFO:teuthology.orchestra.run.smithi041.stdout:Installing dependencies: 2020-07-16T20:28:09.053 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 22 M 2020-07-16T20:28:09.053 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mds x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.1 M 2020-07-16T20:28:09.053 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mon x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 4.9 M 2020-07-16T20:28:09.054 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-osd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 18 M 2020-07-16T20:28:09.054 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-selinux x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 25 k 2020-07-16T20:28:09.054 INFO:teuthology.orchestra.run.smithi041.stdout: libradosstriper1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 484 k 2020-07-16T20:28:09.055 INFO:teuthology.orchestra.run.smithi041.stdout: librgw2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.4 M 2020-07-16T20:28:09.055 INFO:teuthology.orchestra.run.smithi041.stdout: python3-ceph-argparse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 40 k 2020-07-16T20:28:09.055 INFO:teuthology.orchestra.run.smithi041.stdout: python3-ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 67 k 2020-07-16T20:28:09.056 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-grafana-dashboards noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 24 k 2020-07-16T20:28:09.056 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-modules-core noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 174 k 2020-07-16T20:28:09.056 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-prometheus-alerts noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.8 k 2020-07-16T20:28:09.057 INFO:teuthology.orchestra.run.smithi041.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-07-16T20:28:09.057 INFO:teuthology.orchestra.run.smithi041.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-07-16T20:28:09.057 INFO:teuthology.orchestra.run.smithi041.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-07-16T20:28:09.058 INFO:teuthology.orchestra.run.smithi041.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-07-16T20:28:09.058 INFO:teuthology.orchestra.run.smithi041.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-07-16T20:28:09.059 INFO:teuthology.orchestra.run.smithi041.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-07-16T20:28:09.059 INFO:teuthology.orchestra.run.smithi041.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-07-16T20:28:09.060 INFO:teuthology.orchestra.run.smithi041.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-07-16T20:28:09.060 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-07-16T20:28:09.060 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-07-16T20:28:09.061 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-07-16T20:28:09.061 INFO:teuthology.orchestra.run.smithi041.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-07-16T20:28:09.061 INFO:teuthology.orchestra.run.smithi041.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-07-16T20:28:09.062 INFO:teuthology.orchestra.run.smithi041.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-07-16T20:28:09.062 INFO:teuthology.orchestra.run.smithi041.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-07-16T20:28:09.062 INFO:teuthology.orchestra.run.smithi041.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-07-16T20:28:09.063 INFO:teuthology.orchestra.run.smithi041.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-07-16T20:28:09.063 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-07-16T20:28:09.063 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-07-16T20:28:09.064 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-07-16T20:28:09.064 INFO:teuthology.orchestra.run.smithi041.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-07-16T20:28:09.064 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-07-16T20:28:09.065 INFO:teuthology.orchestra.run.smithi041.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-07-16T20:28:09.065 INFO:teuthology.orchestra.run.smithi041.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-07-16T20:28:09.065 INFO:teuthology.orchestra.run.smithi041.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-07-16T20:28:09.066 INFO:teuthology.orchestra.run.smithi041.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-07-16T20:28:09.066 INFO:teuthology.orchestra.run.smithi041.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-07-16T20:28:09.066 INFO:teuthology.orchestra.run.smithi041.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-07-16T20:28:09.067 INFO:teuthology.orchestra.run.smithi041.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-07-16T20:28:09.067 INFO:teuthology.orchestra.run.smithi041.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-07-16T20:28:09.067 INFO:teuthology.orchestra.run.smithi041.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-07-16T20:28:09.068 INFO:teuthology.orchestra.run.smithi041.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-07-16T20:28:09.068 INFO:teuthology.orchestra.run.smithi041.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-07-16T20:28:09.068 INFO:teuthology.orchestra.run.smithi041.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-07-16T20:28:09.069 INFO:teuthology.orchestra.run.smithi041.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-07-16T20:28:09.070 INFO:teuthology.orchestra.run.smithi041.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-07-16T20:28:09.070 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-07-16T20:28:09.070 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-07-16T20:28:09.071 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-07-16T20:28:09.071 INFO:teuthology.orchestra.run.smithi041.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-07-16T20:28:09.071 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-07-16T20:28:09.072 INFO:teuthology.orchestra.run.smithi041.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-07-16T20:28:09.072 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-07-16T20:28:09.072 INFO:teuthology.orchestra.run.smithi041.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-07-16T20:28:09.073 INFO:teuthology.orchestra.run.smithi041.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-07-16T20:28:09.073 INFO:teuthology.orchestra.run.smithi041.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-07-16T20:28:09.073 INFO:teuthology.orchestra.run.smithi041.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-07-16T20:28:09.074 INFO:teuthology.orchestra.run.smithi041.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-07-16T20:28:09.074 INFO:teuthology.orchestra.run.smithi041.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-07-16T20:28:09.074 INFO:teuthology.orchestra.run.smithi041.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-07-16T20:28:09.075 INFO:teuthology.orchestra.run.smithi041.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-07-16T20:28:09.075 INFO:teuthology.orchestra.run.smithi041.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-07-16T20:28:09.075 INFO:teuthology.orchestra.run.smithi041.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-07-16T20:28:09.076 INFO:teuthology.orchestra.run.smithi041.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-07-16T20:28:09.076 INFO:teuthology.orchestra.run.smithi041.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-07-16T20:28:09.076 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-07-16T20:28:09.077 INFO:teuthology.orchestra.run.smithi041.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-07-16T20:28:09.077 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-07-16T20:28:09.077 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-07-16T20:28:09.078 INFO:teuthology.orchestra.run.smithi041.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-07-16T20:28:09.078 INFO:teuthology.orchestra.run.smithi041.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-07-16T20:28:09.078 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-07-16T20:28:09.079 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-07-16T20:28:09.079 INFO:teuthology.orchestra.run.smithi041.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-07-16T20:28:09.079 INFO:teuthology.orchestra.run.smithi041.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-07-16T20:28:09.080 INFO:teuthology.orchestra.run.smithi041.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-07-16T20:28:09.080 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-07-16T20:28:09.081 INFO:teuthology.orchestra.run.smithi041.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-07-16T20:28:09.081 INFO:teuthology.orchestra.run.smithi041.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-07-16T20:28:09.082 INFO:teuthology.orchestra.run.smithi041.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-07-16T20:28:09.082 INFO:teuthology.orchestra.run.smithi041.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-07-16T20:28:09.082 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-07-16T20:28:09.083 INFO:teuthology.orchestra.run.smithi041.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-07-16T20:28:09.083 INFO:teuthology.orchestra.run.smithi041.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-07-16T20:28:09.083 INFO:teuthology.orchestra.run.smithi041.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-07-16T20:28:09.083 INFO:teuthology.orchestra.run.smithi041.stdout: python3-trustme noarch0.5.2-4.el8 epel 26 k 2020-07-16T20:28:09.084 INFO:teuthology.orchestra.run.smithi041.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-07-16T20:28:09.084 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-07-16T20:28:09.084 INFO:teuthology.orchestra.run.smithi041.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-07-16T20:28:09.085 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-07-16T20:28:09.085 INFO:teuthology.orchestra.run.smithi041.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-07-16T20:28:09.086 INFO:teuthology.orchestra.run.smithi041.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-07-16T20:28:09.086 INFO:teuthology.orchestra.run.smithi041.stdout:Installing weak dependencies: 2020-07-16T20:28:09.086 INFO:teuthology.orchestra.run.smithi041.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-07-16T20:28:09.087 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-07-16T20:28:09.087 INFO:teuthology.orchestra.run.smithi041.stdout:Downgrading: 2020-07-16T20:28:09.087 INFO:teuthology.orchestra.run.smithi041.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-07-16T20:28:09.088 INFO:teuthology.orchestra.run.smithi041.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-07-16T20:28:09.088 INFO:teuthology.orchestra.run.smithi041.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-07-16T20:28:09.088 INFO:teuthology.orchestra.run.smithi041.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-07-16T20:28:09.088 INFO:teuthology.orchestra.run.smithi041.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-07-16T20:28:09.089 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:28:09.089 INFO:teuthology.orchestra.run.smithi041.stdout:Transaction Summary 2020-07-16T20:28:09.089 INFO:teuthology.orchestra.run.smithi041.stdout:================================================================================ 2020-07-16T20:28:09.090 INFO:teuthology.orchestra.run.smithi041.stdout:Install 126 Packages 2020-07-16T20:28:09.091 INFO:teuthology.orchestra.run.smithi041.stdout:Upgrade 6 Packages 2020-07-16T20:28:09.092 INFO:teuthology.orchestra.run.smithi041.stdout:Downgrade 5 Packages 2020-07-16T20:28:09.092 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:28:09.093 INFO:teuthology.orchestra.run.smithi041.stdout:Total download size: 195 M 2020-07-16T20:28:09.093 INFO:teuthology.orchestra.run.smithi041.stdout:Downloading Packages: 2020-07-16T20:28:09.096 INFO:teuthology.orchestra.run.smithi041.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 20 MB/s | 851 kB 00:00 2020-07-16T20:28:09.099 INFO:teuthology.orchestra.run.smithi041.stdout:(2/137): libkadm5-1.17-9.el8.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2020-07-16T20:28:09.114 INFO:teuthology.orchestra.run.smithi041.stdout:(3/137): krb5-workstation-1.17-9.el8.x86_64.rpm 16 MB/s | 940 kB 00:00 2020-07-16T20:28:09.116 INFO:teuthology.orchestra.run.smithi041.stdout:(4/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 33 MB/s | 686 kB 00:00 2020-07-16T20:28:09.126 INFO:teuthology.orchestra.run.smithi041.stdout:(5/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 54 MB/s | 1.5 MB 00:00 2020-07-16T20:28:09.182 INFO:teuthology.orchestra.run.smithi157.stdout:(9/137): ceph-mds-16.0.0-3565.g8e60ca350a5.el8. 8.5 MB/s | 2.1 MB 00:00 2020-07-16T20:28:09.315 INFO:teuthology.orchestra.run.smithi041.stdout:(6/137): ceph-16.0.0-3565.g8e60ca350a5.el8.x86_ 32 kB/s | 6.5 kB 00:00 2020-07-16T20:28:09.391 INFO:teuthology.orchestra.run.smithi157.stdout:(10/137): ceph-mgr-16.0.0-3565.g8e60ca350a5.el8 7.3 MB/s | 1.5 MB 00:00 2020-07-16T20:28:09.413 INFO:teuthology.orchestra.run.smithi157.stdout:(11/137): ceph-base-16.0.0-3565.g8e60ca350a5.el 8.3 MB/s | 6.0 MB 00:00 2020-07-16T20:28:09.878 INFO:teuthology.orchestra.run.smithi041.stdout:(7/137): ceph-fuse-16.0.0-3565.g8e60ca350a5.el8 1.0 MB/s | 604 kB 00:00 2020-07-16T20:28:10.010 INFO:teuthology.orchestra.run.smithi041.stdout:(8/137): ceph-immutable-object-cache-16.0.0-356 1.5 MB/s | 202 kB 00:00 2020-07-16T20:28:10.041 INFO:teuthology.orchestra.run.smithi157.stdout:(12/137): ceph-mon-16.0.0-3565.g8e60ca350a5.el8 7.6 MB/s | 4.9 MB 00:00 2020-07-16T20:28:10.901 INFO:teuthology.orchestra.run.smithi041.stdout:(9/137): ceph-mds-16.0.0-3565.g8e60ca350a5.el8. 2.4 MB/s | 2.1 MB 00:00 2020-07-16T20:28:11.340 INFO:teuthology.orchestra.run.smithi041.stdout:(10/137): ceph-mgr-16.0.0-3565.g8e60ca350a5.el8 3.6 MB/s | 1.5 MB 00:00 2020-07-16T20:28:11.348 INFO:teuthology.orchestra.run.smithi157.stdout:(13/137): ceph-common-16.0.0-3565.g8e60ca350a5. 8.3 MB/s | 22 MB 00:02 2020-07-16T20:28:11.494 INFO:teuthology.orchestra.run.smithi157.stdout:(14/137): ceph-osd-16.0.0-3565.g8e60ca350a5.el8 8.6 MB/s | 18 MB 00:02 2020-07-16T20:28:11.494 INFO:teuthology.orchestra.run.smithi157.stdout:(15/137): ceph-selinux-16.0.0-3565.g8e60ca350a5 170 kB/s | 25 kB 00:00 2020-07-16T20:28:11.591 INFO:teuthology.orchestra.run.smithi157.stdout:(16/137): ceph-radosgw-16.0.0-3565.g8e60ca350a5 6.7 MB/s | 10 MB 00:01 2020-07-16T20:28:11.592 INFO:teuthology.orchestra.run.smithi157.stdout:(17/137): cephadm-16.0.0-3565.g8e60ca350a5.el8. 494 kB/s | 48 kB 00:00 2020-07-16T20:28:11.638 INFO:teuthology.orchestra.run.smithi157.stdout:(18/137): libcephfs-devel-16.0.0-3565.g8e60ca35 498 kB/s | 23 kB 00:00 2020-07-16T20:28:11.660 INFO:teuthology.orchestra.run.smithi157.stdout:(19/137): libcephfs2-16.0.0-3565.g8e60ca350a5.e 7.8 MB/s | 536 kB 00:00 2020-07-16T20:28:11.706 INFO:teuthology.orchestra.run.smithi157.stdout:(20/137): librados-devel-16.0.0-3565.g8e60ca350 1.9 MB/s | 131 kB 00:00 2020-07-16T20:28:11.728 INFO:teuthology.orchestra.run.smithi157.stdout:(21/137): libradosstriper1-16.0.0-3565.g8e60ca3 7.1 MB/s | 484 kB 00:00 2020-07-16T20:28:11.794 INFO:teuthology.orchestra.run.smithi157.stdout:(22/137): python3-ceph-argparse-16.0.0-3565.g8e 592 kB/s | 40 kB 00:00 2020-07-16T20:28:11.820 INFO:teuthology.orchestra.run.smithi041.stdout:(11/137): ceph-mon-16.0.0-3565.g8e60ca350a5.el8 9.9 MB/s | 4.9 MB 00:00 2020-07-16T20:28:11.857 INFO:teuthology.orchestra.run.smithi157.stdout:(23/137): python3-ceph-common-16.0.0-3565.g8e60 1.1 MB/s | 67 kB 00:00 2020-07-16T20:28:11.933 INFO:teuthology.orchestra.run.smithi157.stdout:(24/137): python3-cephfs-16.0.0-3565.g8e60ca350 2.6 MB/s | 204 kB 00:00 2020-07-16T20:28:12.016 INFO:teuthology.orchestra.run.smithi157.stdout:(25/137): python3-rados-16.0.0-3565.g8e60ca350a 4.3 MB/s | 364 kB 00:00 2020-07-16T20:28:12.100 INFO:teuthology.orchestra.run.smithi157.stdout:(26/137): python3-rbd-16.0.0-3565.g8e60ca350a5. 3.9 MB/s | 335 kB 00:00 2020-07-16T20:28:12.163 INFO:teuthology.orchestra.run.smithi157.stdout:(27/137): librgw2-16.0.0-3565.g8e60ca350a5.el8. 7.4 MB/s | 3.4 MB 00:00 2020-07-16T20:28:12.170 INFO:teuthology.orchestra.run.smithi157.stdout:(28/137): python3-rgw-16.0.0-3565.g8e60ca350a5. 1.6 MB/s | 113 kB 00:00 2020-07-16T20:28:12.221 INFO:teuthology.orchestra.run.smithi157.stdout:(29/137): rbd-fuse-16.0.0-3565.g8e60ca350a5.el8 1.5 MB/s | 87 kB 00:00 2020-07-16T20:28:12.296 INFO:teuthology.orchestra.run.smithi157.stdout:(30/137): rbd-nbd-16.0.0-3565.g8e60ca350a5.el8. 2.1 MB/s | 161 kB 00:00 2020-07-16T20:28:12.368 INFO:teuthology.orchestra.run.smithi157.stdout:(31/137): ceph-grafana-dashboards-16.0.0-3565.g 334 kB/s | 24 kB 00:00 2020-07-16T20:28:12.443 INFO:teuthology.orchestra.run.smithi157.stdout:(32/137): ceph-mgr-cephadm-16.0.0-3565.g8e60ca3 730 kB/s | 54 kB 00:00 2020-07-16T20:28:12.524 INFO:teuthology.orchestra.run.smithi157.stdout:(33/137): rbd-mirror-16.0.0-3565.g8e60ca350a5.e 7.7 MB/s | 2.7 MB 00:00 2020-07-16T20:28:13.164 INFO:teuthology.orchestra.run.smithi157.stdout:(34/137): ceph-mgr-dashboard-16.0.0-3565.g8e60c 4.8 MB/s | 3.5 MB 00:00 2020-07-16T20:28:13.228 INFO:teuthology.orchestra.run.smithi157.stdout:(35/137): ceph-mgr-modules-core-16.0.0-3565.g8e 2.7 MB/s | 174 kB 00:00 2020-07-16T20:28:13.286 INFO:teuthology.orchestra.run.smithi157.stdout:(36/137): ceph-mgr-rook-16.0.0-3565.g8e60ca350a 466 kB/s | 27 kB 00:00 2020-07-16T20:28:13.344 INFO:teuthology.orchestra.run.smithi157.stdout:(37/137): ceph-prometheus-alerts-16.0.0-3565.g8 150 kB/s | 8.8 kB 00:00 2020-07-16T20:28:13.355 INFO:teuthology.orchestra.run.smithi157.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 70 MB/s | 713 kB 00:00 2020-07-16T20:28:13.364 INFO:teuthology.orchestra.run.smithi157.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 73 MB/s | 688 kB 00:00 2020-07-16T20:28:13.369 INFO:teuthology.orchestra.run.smithi157.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 70 MB/s | 320 kB 00:00 2020-07-16T20:28:13.371 INFO:teuthology.orchestra.run.smithi157.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 59 MB/s | 161 kB 00:00 2020-07-16T20:28:13.376 INFO:teuthology.orchestra.run.smithi157.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 73 MB/s | 353 kB 00:00 2020-07-16T20:28:13.387 INFO:teuthology.orchestra.run.smithi157.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 78 MB/s | 709 kB 00:00 2020-07-16T20:28:13.452 INFO:teuthology.orchestra.run.smithi157.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-07-16T20:28:13.452 INFO:teuthology.orchestra.run.smithi157.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 65 MB/s | 188 kB 00:00 2020-07-16T20:28:13.452 INFO:teuthology.orchestra.run.smithi157.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 83 MB/s | 4.3 MB 00:00 2020-07-16T20:28:13.497 INFO:teuthology.orchestra.run.smithi157.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 85 MB/s | 4.4 MB 00:00 2020-07-16T20:28:13.554 INFO:teuthology.orchestra.run.smithi157.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 85 MB/s | 4.8 MB 00:00 2020-07-16T20:28:13.566 INFO:teuthology.orchestra.run.smithi157.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 63 MB/s | 214 kB 00:00 2020-07-16T20:28:13.567 INFO:teuthology.orchestra.run.smithi157.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 74 MB/s | 538 kB 00:00 2020-07-16T20:28:13.567 INFO:teuthology.orchestra.run.smithi157.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 24 MB/s | 27 kB 00:00 2020-07-16T20:28:13.571 INFO:teuthology.orchestra.run.smithi157.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-07-16T20:28:13.586 INFO:teuthology.orchestra.run.smithi157.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 80 MB/s | 1.5 MB 00:00 2020-07-16T20:28:13.588 INFO:teuthology.orchestra.run.smithi157.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 60 MB/s | 157 kB 00:00 2020-07-16T20:28:13.589 INFO:teuthology.orchestra.run.smithi157.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 34 MB/s | 39 kB 00:00 2020-07-16T20:28:13.634 INFO:teuthology.orchestra.run.smithi157.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 85 MB/s | 3.7 MB 00:00 2020-07-16T20:28:13.643 INFO:teuthology.orchestra.run.smithi157.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 63 MB/s | 225 kB 00:00 2020-07-16T20:28:13.644 INFO:teuthology.orchestra.run.smithi157.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 36 MB/s | 44 kB 00:00 2020-07-16T20:28:13.644 INFO:teuthology.orchestra.run.smithi157.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 59 MB/s | 126 kB 00:00 2020-07-16T20:28:13.645 INFO:teuthology.orchestra.run.smithi157.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 55 MB/s | 110 kB 00:00 2020-07-16T20:28:13.667 INFO:teuthology.orchestra.run.smithi157.stdout:(61/137): ceph-mgr-diskprediction-local-16.0.0- 7.5 MB/s | 8.6 MB 00:01 2020-07-16T20:28:13.668 INFO:teuthology.orchestra.run.smithi157.stdout:(62/137): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2020-07-16T20:28:13.669 INFO:teuthology.orchestra.run.smithi157.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 23 MB/s | 27 kB 00:00 2020-07-16T20:28:13.676 INFO:teuthology.orchestra.run.smithi157.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 60 MB/s | 457 kB 00:00 2020-07-16T20:28:13.682 INFO:teuthology.orchestra.run.smithi157.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 51 MB/s | 298 kB 00:00 2020-07-16T20:28:13.685 INFO:teuthology.orchestra.run.smithi157.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 26 MB/s | 54 kB 00:00 2020-07-16T20:28:13.688 INFO:teuthology.orchestra.run.smithi157.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 29 MB/s | 82 kB 00:00 2020-07-16T20:28:13.689 INFO:teuthology.orchestra.run.smithi157.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 12 MB/s | 21 kB 00:00 2020-07-16T20:28:13.691 INFO:teuthology.orchestra.run.smithi157.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 20 MB/s | 48 kB 00:00 2020-07-16T20:28:13.701 INFO:teuthology.orchestra.run.smithi157.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 55 MB/s | 548 kB 00:00 2020-07-16T20:28:13.703 INFO:teuthology.orchestra.run.smithi157.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 10 MB/s | 19 kB 00:00 2020-07-16T20:28:13.706 INFO:teuthology.orchestra.run.smithi157.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 15 MB/s | 38 kB 00:00 2020-07-16T20:28:13.717 INFO:teuthology.orchestra.run.smithi157.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 57 MB/s | 638 kB 00:00 2020-07-16T20:28:13.722 INFO:teuthology.orchestra.run.smithi157.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 35 MB/s | 169 kB 00:00 2020-07-16T20:28:13.729 INFO:teuthology.orchestra.run.smithi157.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 17 MB/s | 47 kB 00:00 2020-07-16T20:28:13.730 INFO:teuthology.orchestra.run.smithi157.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 36 MB/s | 199 kB 00:00 2020-07-16T20:28:13.735 INFO:teuthology.orchestra.run.smithi157.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 22 MB/s | 86 kB 00:00 2020-07-16T20:28:13.738 INFO:teuthology.orchestra.run.smithi157.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 25 MB/s | 95 kB 00:00 2020-07-16T20:28:13.741 INFO:teuthology.orchestra.run.smithi157.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 6.9 MB/s | 18 kB 00:00 2020-07-16T20:28:13.759 INFO:teuthology.orchestra.run.smithi157.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 38 MB/s | 249 kB 00:00 2020-07-16T20:28:13.770 INFO:teuthology.orchestra.run.smithi041.stdout:(12/137): ceph-osd-16.0.0-3565.g8e60ca350a5.el8 9.2 MB/s | 18 MB 00:01 2020-07-16T20:28:13.791 INFO:teuthology.orchestra.run.smithi157.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 57 MB/s | 2.3 MB 00:00 2020-07-16T20:28:13.803 INFO:teuthology.orchestra.run.smithi157.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 45 MB/s | 605 kB 00:00 2020-07-16T20:28:13.809 INFO:teuthology.orchestra.run.smithi157.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 33 MB/s | 228 kB 00:00 2020-07-16T20:28:13.815 INFO:teuthology.orchestra.run.smithi157.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 32 MB/s | 220 kB 00:00 2020-07-16T20:28:13.838 INFO:teuthology.orchestra.run.smithi157.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 27 MB/s | 195 kB 00:00 2020-07-16T20:28:13.839 INFO:teuthology.orchestra.run.smithi157.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 9.7 MB/s | 43 kB 00:00 2020-07-16T20:28:13.839 INFO:teuthology.orchestra.run.smithi157.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 23 MB/s | 155 kB 00:00 2020-07-16T20:28:13.839 INFO:teuthology.orchestra.run.smithi157.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 6.8 MB/s | 34 kB 00:00 2020-07-16T20:28:13.846 INFO:teuthology.orchestra.run.smithi157.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 18 MB/s | 123 kB 00:00 2020-07-16T20:28:13.854 INFO:teuthology.orchestra.run.smithi157.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 8.4 MB/s | 43 kB 00:00 2020-07-16T20:28:13.858 INFO:teuthology.orchestra.run.smithi157.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 22 MB/s | 176 kB 00:00 2020-07-16T20:28:13.864 INFO:teuthology.orchestra.run.smithi157.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 12 MB/s | 69 kB 00:00 2020-07-16T20:28:13.882 INFO:teuthology.orchestra.run.smithi157.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 8.9 MB/s | 56 kB 00:00 2020-07-16T20:28:13.980 INFO:teuthology.orchestra.run.smithi157.stdout:(94/137): python3-scipy-1.0.0-20.module_el8.1.0 48 MB/s | 15 MB 00:00 2020-07-16T20:28:14.035 INFO:teuthology.orchestra.run.smithi157.stdout:(95/137): fmt-6.2.1-1.el8.x86_64.rpm 712 kB/s | 116 kB 00:00 2020-07-16T20:28:14.066 INFO:teuthology.orchestra.run.smithi157.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 5.6 MB/s | 181 kB 00:00 2020-07-16T20:28:14.082 INFO:teuthology.orchestra.run.smithi157.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-07-16T20:28:14.085 INFO:teuthology.orchestra.run.smithi157.stdout:(98/137): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-07-16T20:28:14.100 INFO:teuthology.orchestra.run.smithi157.stdout:(99/137): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-07-16T20:28:14.104 INFO:teuthology.orchestra.run.smithi157.stdout:(100/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-07-16T20:28:14.119 INFO:teuthology.orchestra.run.smithi157.stdout:(101/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-07-16T20:28:14.125 INFO:teuthology.orchestra.run.smithi157.stdout:(102/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.9 MB/s | 185 kB 00:00 2020-07-16T20:28:14.134 INFO:teuthology.orchestra.run.smithi157.stdout:(103/137): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-07-16T20:28:14.144 INFO:teuthology.orchestra.run.smithi157.stdout:(104/137): python3-certifi-2018.10.15-7.el8.noa 867 kB/s | 16 kB 00:00 2020-07-16T20:28:14.147 INFO:teuthology.orchestra.run.smithi157.stdout:(105/137): python3-cheroot-8.2.1-1.el8.noarch.r 8.6 MB/s | 145 kB 00:00 2020-07-16T20:28:14.163 INFO:teuthology.orchestra.run.smithi157.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-07-16T20:28:14.182 INFO:teuthology.orchestra.run.smithi157.stdout:(107/137): python3-cherrypy-18.4.0-1.el8.noarch 9.9 MB/s | 384 kB 00:00 2020-07-16T20:28:14.195 INFO:teuthology.orchestra.run.smithi157.stdout:(108/137): python3-execnet-1.7.1-1.el8.noarch.r 11 MB/s | 355 kB 00:00 2020-07-16T20:28:14.202 INFO:teuthology.orchestra.run.smithi157.stdout:(109/137): python3-google-auth-1.1.1-10.el8.noa 4.1 MB/s | 81 kB 00:00 2020-07-16T20:28:14.211 INFO:teuthology.orchestra.run.smithi157.stdout:(110/137): python3-jaraco-6.2-6.el8.noarch.rpm 713 kB/s | 11 kB 00:00 2020-07-16T20:28:14.220 INFO:teuthology.orchestra.run.smithi157.stdout:(111/137): python3-jaraco-functools-2.0-4.el8.n 934 kB/s | 18 kB 00:00 2020-07-16T20:28:14.240 INFO:teuthology.orchestra.run.smithi157.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.5 MB/s | 49 kB 00:00 2020-07-16T20:28:14.261 INFO:teuthology.orchestra.run.smithi157.stdout:(113/137): python3-kubernetes-11.0.0-2.el8.noar 23 MB/s | 1.2 MB 00:00 2020-07-16T20:28:14.262 INFO:teuthology.orchestra.run.smithi157.stdout:(114/137): python3-more-itertools-7.2.0-3.el8.n 2.7 MB/s | 59 kB 00:00 2020-07-16T20:28:14.282 INFO:teuthology.orchestra.run.smithi157.stdout:(115/137): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-07-16T20:28:14.283 INFO:teuthology.orchestra.run.smithi157.stdout:(116/137): python3-portend-2.6-1.el8.noarch.rpm 808 kB/s | 16 kB 00:00 2020-07-16T20:28:14.296 INFO:teuthology.orchestra.run.smithi157.stdout:(117/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.9 MB/s | 48 kB 00:00 2020-07-16T20:28:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:(118/137): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2020-07-16T20:28:14.313 INFO:teuthology.orchestra.run.smithi157.stdout:(119/137): python3-routes-2.4.1-12.el8.noarch.r 12 MB/s | 196 kB 00:00 2020-07-16T20:28:14.330 INFO:teuthology.orchestra.run.smithi157.stdout:(120/137): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-07-16T20:28:14.331 INFO:teuthology.orchestra.run.smithi157.stdout:(121/137): python3-simplegeneric-0.8.1-17.el8.n 1.2 MB/s | 19 kB 00:00 2020-07-16T20:28:14.339 INFO:teuthology.orchestra.run.smithi157.stdout:(122/137): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2020-07-16T20:28:14.345 INFO:teuthology.orchestra.run.smithi157.stdout:(123/137): python3-tempora-1.14.1-5.el8.noarch. 1.8 MB/s | 29 kB 00:00 2020-07-16T20:28:14.358 INFO:teuthology.orchestra.run.smithi157.stdout:(124/137): python3-trustme-0.5.2-4.el8.noarch.r 1.4 MB/s | 26 kB 00:00 2020-07-16T20:28:14.362 INFO:teuthology.orchestra.run.smithi157.stdout:(125/137): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-07-16T20:28:14.378 INFO:teuthology.orchestra.run.smithi157.stdout:(126/137): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-07-16T20:28:14.380 INFO:teuthology.orchestra.run.smithi157.stdout:(127/137): python3-webob-1.8.5-1.el8.1.noarch.r 11 MB/s | 251 kB 00:00 2020-07-16T20:28:14.395 INFO:teuthology.orchestra.run.smithi157.stdout:(128/137): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-07-16T20:28:14.401 INFO:teuthology.orchestra.run.smithi157.stdout:(129/137): python3-zc-lockfile-2.0-2.el8.noarch 1.2 MB/s | 23 kB 00:00 2020-07-16T20:28:14.411 INFO:teuthology.orchestra.run.smithi157.stdout:(130/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-07-16T20:28:14.418 INFO:teuthology.orchestra.run.smithi041.stdout:(13/137): ceph-radosgw-16.0.0-3565.g8e60ca350a5 16 MB/s | 10 MB 00:00 2020-07-16T20:28:14.507 INFO:teuthology.orchestra.run.smithi041.stdout:(14/137): ceph-base-16.0.0-3565.g8e60ca350a5.el 1.1 MB/s | 6.0 MB 00:05 2020-07-16T20:28:14.507 INFO:teuthology.orchestra.run.smithi041.stdout:(15/137): ceph-selinux-16.0.0-3565.g8e60ca350a5 282 kB/s | 25 kB 00:00 2020-07-16T20:28:14.570 INFO:teuthology.orchestra.run.smithi041.stdout:(16/137): cephadm-16.0.0-3565.g8e60ca350a5.el8. 887 kB/s | 48 kB 00:00 2020-07-16T20:28:14.615 INFO:teuthology.orchestra.run.smithi041.stdout:(17/137): libcephfs-devel-16.0.0-3565.g8e60ca35 442 kB/s | 23 kB 00:00 2020-07-16T20:28:14.658 INFO:teuthology.orchestra.run.smithi157.stdout:(131/137): librbd1-16.0.0-3565.g8e60ca350a5.el8 8.1 MB/s | 2.0 MB 00:00 2020-07-16T20:28:14.675 INFO:teuthology.orchestra.run.smithi041.stdout:(18/137): libcephfs2-16.0.0-3565.g8e60ca350a5.e 8.7 MB/s | 536 kB 00:00 2020-07-16T20:28:14.683 INFO:teuthology.orchestra.run.smithi157.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 83 MB/s | 2.1 MB 00:00 2020-07-16T20:28:14.705 INFO:teuthology.orchestra.run.smithi157.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 81 MB/s | 1.7 MB 00:00 2020-07-16T20:28:14.707 INFO:teuthology.orchestra.run.smithi157.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 60 MB/s | 133 kB 00:00 2020-07-16T20:28:14.711 INFO:teuthology.orchestra.run.smithi157.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 71 MB/s | 308 kB 00:00 2020-07-16T20:28:14.722 INFO:teuthology.orchestra.run.smithi041.stdout:(19/137): librados-devel-16.0.0-3565.g8e60ca350 3.2 MB/s | 131 kB 00:00 2020-07-16T20:28:14.770 INFO:teuthology.orchestra.run.smithi041.stdout:(20/137): libradosstriper1-16.0.0-3565.g8e60ca3 8.7 MB/s | 484 kB 00:00 2020-07-16T20:28:14.917 INFO:teuthology.orchestra.run.smithi157.stdout:(136/137): librados2-16.0.0-3565.g8e60ca350a5.e 7.2 MB/s | 3.7 MB 00:00 2020-07-16T20:28:15.036 INFO:teuthology.orchestra.run.smithi041.stdout:(21/137): librgw2-16.0.0-3565.g8e60ca350a5.el8. 13 MB/s | 3.4 MB 00:00 2020-07-16T20:28:15.062 INFO:teuthology.orchestra.run.smithi041.stdout:(22/137): python3-ceph-argparse-16.0.0-3565.g8e 1.6 MB/s | 40 kB 00:00 2020-07-16T20:28:15.086 INFO:teuthology.orchestra.run.smithi041.stdout:(23/137): python3-ceph-common-16.0.0-3565.g8e60 2.7 MB/s | 67 kB 00:00 2020-07-16T20:28:15.113 INFO:teuthology.orchestra.run.smithi041.stdout:(24/137): python3-cephfs-16.0.0-3565.g8e60ca350 7.5 MB/s | 204 kB 00:00 2020-07-16T20:28:15.147 INFO:teuthology.orchestra.run.smithi041.stdout:(25/137): python3-rados-16.0.0-3565.g8e60ca350a 11 MB/s | 364 kB 00:00 2020-07-16T20:28:15.180 INFO:teuthology.orchestra.run.smithi041.stdout:(26/137): python3-rbd-16.0.0-3565.g8e60ca350a5. 9.8 MB/s | 335 kB 00:00 2020-07-16T20:28:15.208 INFO:teuthology.orchestra.run.smithi041.stdout:(27/137): python3-rgw-16.0.0-3565.g8e60ca350a5. 4.5 MB/s | 113 kB 00:00 2020-07-16T20:28:15.230 INFO:teuthology.orchestra.run.smithi041.stdout:(28/137): rbd-fuse-16.0.0-3565.g8e60ca350a5.el8 3.6 MB/s | 87 kB 00:00 2020-07-16T20:28:15.412 INFO:teuthology.orchestra.run.smithi041.stdout:(29/137): rbd-mirror-16.0.0-3565.g8e60ca350a5.e 15 MB/s | 2.7 MB 00:00 2020-07-16T20:28:15.442 INFO:teuthology.orchestra.run.smithi041.stdout:(30/137): rbd-nbd-16.0.0-3565.g8e60ca350a5.el8. 5.4 MB/s | 161 kB 00:00 2020-07-16T20:28:15.465 INFO:teuthology.orchestra.run.smithi041.stdout:(31/137): ceph-grafana-dashboards-16.0.0-3565.g 1.0 MB/s | 24 kB 00:00 2020-07-16T20:28:15.489 INFO:teuthology.orchestra.run.smithi041.stdout:(32/137): ceph-mgr-cephadm-16.0.0-3565.g8e60ca3 2.3 MB/s | 54 kB 00:00 2020-07-16T20:28:15.722 INFO:teuthology.orchestra.run.smithi041.stdout:(33/137): ceph-mgr-dashboard-16.0.0-3565.g8e60c 15 MB/s | 3.5 MB 00:00 2020-07-16T20:28:16.321 INFO:teuthology.orchestra.run.smithi041.stdout:(34/137): ceph-mgr-diskprediction-local-16.0.0- 14 MB/s | 8.6 MB 00:00 2020-07-16T20:28:16.348 INFO:teuthology.orchestra.run.smithi041.stdout:(35/137): ceph-mgr-modules-core-16.0.0-3565.g8e 6.6 MB/s | 174 kB 00:00 2020-07-16T20:28:16.371 INFO:teuthology.orchestra.run.smithi041.stdout:(36/137): ceph-mgr-rook-16.0.0-3565.g8e60ca350a 1.1 MB/s | 27 kB 00:00 2020-07-16T20:28:16.394 INFO:teuthology.orchestra.run.smithi041.stdout:(37/137): ceph-prometheus-alerts-16.0.0-3565.g8 379 kB/s | 8.8 kB 00:00 2020-07-16T20:28:16.443 INFO:teuthology.orchestra.run.smithi041.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-07-16T20:28:16.443 INFO:teuthology.orchestra.run.smithi041.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 73 MB/s | 688 kB 00:00 2020-07-16T20:28:16.446 INFO:teuthology.orchestra.run.smithi041.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 69 MB/s | 320 kB 00:00 2020-07-16T20:28:16.449 INFO:teuthology.orchestra.run.smithi041.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 57 MB/s | 161 kB 00:00 2020-07-16T20:28:16.454 INFO:teuthology.orchestra.run.smithi041.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 70 MB/s | 353 kB 00:00 2020-07-16T20:28:16.464 INFO:teuthology.orchestra.run.smithi041.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 73 MB/s | 709 kB 00:00 2020-07-16T20:28:16.468 INFO:teuthology.orchestra.run.smithi041.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-07-16T20:28:16.471 INFO:teuthology.orchestra.run.smithi041.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 66 MB/s | 188 kB 00:00 2020-07-16T20:28:16.523 INFO:teuthology.orchestra.run.smithi041.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 83 MB/s | 4.3 MB 00:00 2020-07-16T20:28:16.576 INFO:teuthology.orchestra.run.smithi041.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 84 MB/s | 4.4 MB 00:00 2020-07-16T20:28:16.633 INFO:teuthology.orchestra.run.smithi041.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 84 MB/s | 4.8 MB 00:00 2020-07-16T20:28:16.636 INFO:teuthology.orchestra.run.smithi041.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 62 MB/s | 214 kB 00:00 2020-07-16T20:28:16.644 INFO:teuthology.orchestra.run.smithi041.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 75 MB/s | 538 kB 00:00 2020-07-16T20:28:16.645 INFO:teuthology.orchestra.run.smithi041.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 25 MB/s | 27 kB 00:00 2020-07-16T20:28:16.646 INFO:teuthology.orchestra.run.smithi041.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-07-16T20:28:16.647 INFO:teuthology.orchestra.run.smithi157.stdout:(137/137): ceph-test-16.0.0-3565.g8e60ca350a5.e 8.7 MB/s | 45 MB 00:05 2020-07-16T20:28:16.652 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-07-16T20:28:16.653 INFO:teuthology.orchestra.run.smithi157.stdout:Total 24 MB/s | 195 MB 00:08 2020-07-16T20:28:16.665 INFO:teuthology.orchestra.run.smithi041.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2020-07-16T20:28:16.668 INFO:teuthology.orchestra.run.smithi041.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 45 MB/s | 157 kB 00:00 2020-07-16T20:28:16.674 INFO:teuthology.orchestra.run.smithi041.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 6.0 MB/s | 39 kB 00:00 2020-07-16T20:28:16.721 INFO:teuthology.orchestra.run.smithi041.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 81 MB/s | 3.7 MB 00:00 2020-07-16T20:28:16.722 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-07-16T20:28:16.724 INFO:teuthology.orchestra.run.smithi041.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 60 MB/s | 225 kB 00:00 2020-07-16T20:28:16.730 INFO:teuthology.orchestra.run.smithi041.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 31 MB/s | 44 kB 00:00 2020-07-16T20:28:16.730 INFO:teuthology.orchestra.run.smithi041.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 56 MB/s | 126 kB 00:00 2020-07-16T20:28:16.731 INFO:teuthology.orchestra.run.smithi041.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 53 MB/s | 110 kB 00:00 2020-07-16T20:28:16.734 INFO:teuthology.orchestra.run.smithi041.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2020-07-16T20:28:16.903 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-07-16T20:28:16.903 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-07-16T20:28:16.971 INFO:teuthology.orchestra.run.smithi041.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 61 MB/s | 15 MB 00:00 2020-07-16T20:28:16.973 INFO:teuthology.orchestra.run.smithi041.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 20 MB/s | 27 kB 00:00 2020-07-16T20:28:16.998 INFO:teuthology.orchestra.run.smithi041.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 73 MB/s | 457 kB 00:00 2020-07-16T20:28:16.999 INFO:teuthology.orchestra.run.smithi041.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 69 MB/s | 298 kB 00:00 2020-07-16T20:28:16.999 INFO:teuthology.orchestra.run.smithi041.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 35 MB/s | 54 kB 00:00 2020-07-16T20:28:16.999 INFO:teuthology.orchestra.run.smithi041.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 43 MB/s | 82 kB 00:00 2020-07-16T20:28:16.999 INFO:teuthology.orchestra.run.smithi041.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 19 MB/s | 21 kB 00:00 2020-07-16T20:28:17.000 INFO:teuthology.orchestra.run.smithi041.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 34 MB/s | 48 kB 00:00 2020-07-16T20:28:17.000 INFO:teuthology.orchestra.run.smithi041.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 74 MB/s | 548 kB 00:00 2020-07-16T20:28:17.000 INFO:teuthology.orchestra.run.smithi041.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 16 MB/s | 19 kB 00:00 2020-07-16T20:28:17.001 INFO:teuthology.orchestra.run.smithi041.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 30 MB/s | 38 kB 00:00 2020-07-16T20:28:17.009 INFO:teuthology.orchestra.run.smithi041.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 77 MB/s | 638 kB 00:00 2020-07-16T20:28:17.013 INFO:teuthology.orchestra.run.smithi041.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 58 MB/s | 169 kB 00:00 2020-07-16T20:28:17.013 INFO:teuthology.orchestra.run.smithi041.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 37 MB/s | 47 kB 00:00 2020-07-16T20:28:17.016 INFO:teuthology.orchestra.run.smithi041.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 62 MB/s | 199 kB 00:00 2020-07-16T20:28:17.019 INFO:teuthology.orchestra.run.smithi041.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 45 MB/s | 86 kB 00:00 2020-07-16T20:28:17.021 INFO:teuthology.orchestra.run.smithi041.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 49 MB/s | 95 kB 00:00 2020-07-16T20:28:17.022 INFO:teuthology.orchestra.run.smithi041.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 16 MB/s | 18 kB 00:00 2020-07-16T20:28:17.026 INFO:teuthology.orchestra.run.smithi041.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 65 MB/s | 249 kB 00:00 2020-07-16T20:28:17.054 INFO:teuthology.orchestra.run.smithi041.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 82 MB/s | 2.3 MB 00:00 2020-07-16T20:28:17.062 INFO:teuthology.orchestra.run.smithi041.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 75 MB/s | 605 kB 00:00 2020-07-16T20:28:17.066 INFO:teuthology.orchestra.run.smithi041.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 64 MB/s | 228 kB 00:00 2020-07-16T20:28:17.069 INFO:teuthology.orchestra.run.smithi041.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 65 MB/s | 220 kB 00:00 2020-07-16T20:28:17.073 INFO:teuthology.orchestra.run.smithi041.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 64 MB/s | 195 kB 00:00 2020-07-16T20:28:17.074 INFO:teuthology.orchestra.run.smithi041.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 35 MB/s | 43 kB 00:00 2020-07-16T20:28:17.077 INFO:teuthology.orchestra.run.smithi041.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 54 MB/s | 155 kB 00:00 2020-07-16T20:28:17.081 INFO:teuthology.orchestra.run.smithi041.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 28 MB/s | 34 kB 00:00 2020-07-16T20:28:17.082 INFO:teuthology.orchestra.run.smithi041.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 59 MB/s | 123 kB 00:00 2020-07-16T20:28:17.082 INFO:teuthology.orchestra.run.smithi041.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 33 MB/s | 43 kB 00:00 2020-07-16T20:28:17.085 INFO:teuthology.orchestra.run.smithi041.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 62 MB/s | 176 kB 00:00 2020-07-16T20:28:17.087 INFO:teuthology.orchestra.run.smithi041.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 41 MB/s | 69 kB 00:00 2020-07-16T20:28:17.088 INFO:teuthology.orchestra.run.smithi041.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 39 MB/s | 56 kB 00:00 2020-07-16T20:28:17.166 INFO:teuthology.orchestra.run.smithi041.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.5 MB/s | 116 kB 00:00 2020-07-16T20:28:17.198 INFO:teuthology.orchestra.run.smithi041.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 9.6 MB/s | 315 kB 00:00 2020-07-16T20:28:17.216 INFO:teuthology.orchestra.run.smithi041.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 11 MB/s | 181 kB 00:00 2020-07-16T20:28:17.232 INFO:teuthology.orchestra.run.smithi041.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-07-16T20:28:17.248 INFO:teuthology.orchestra.run.smithi041.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-07-16T20:28:17.264 INFO:teuthology.orchestra.run.smithi041.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-07-16T20:28:17.280 INFO:teuthology.orchestra.run.smithi041.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-07-16T20:28:17.297 INFO:teuthology.orchestra.run.smithi041.stdout:(101/137): python3-beautifulsoup4-4.6.3-2.el8.1 11 MB/s | 185 kB 00:00 2020-07-16T20:28:17.313 INFO:teuthology.orchestra.run.smithi041.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-07-16T20:28:17.331 INFO:teuthology.orchestra.run.smithi041.stdout:(103/137): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-07-16T20:28:17.346 INFO:teuthology.orchestra.run.smithi041.stdout:(104/137): python3-cheroot-8.2.1-1.el8.noarch.r 8.5 MB/s | 145 kB 00:00 2020-07-16T20:28:17.377 INFO:teuthology.orchestra.run.smithi041.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 12 MB/s | 384 kB 00:00 2020-07-16T20:28:17.393 INFO:teuthology.orchestra.run.smithi041.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-07-16T20:28:17.411 INFO:teuthology.orchestra.run.smithi041.stdout:(107/137): python3-execnet-1.7.1-1.el8.noarch.r 19 MB/s | 355 kB 00:00 2020-07-16T20:28:17.428 INFO:teuthology.orchestra.run.smithi041.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 4.9 MB/s | 81 kB 00:00 2020-07-16T20:28:17.443 INFO:teuthology.orchestra.run.smithi041.stdout:(109/137): python3-jaraco-6.2-6.el8.noarch.rpm 714 kB/s | 11 kB 00:00 2020-07-16T20:28:17.463 INFO:teuthology.orchestra.run.smithi041.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 1.1 MB/s | 18 kB 00:00 2020-07-16T20:28:17.523 INFO:teuthology.orchestra.run.smithi041.stdout:(111/137): python3-kubernetes-11.0.0-2.el8.noar 18 MB/s | 1.2 MB 00:00 2020-07-16T20:28:17.539 INFO:teuthology.orchestra.run.smithi041.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 3.0 MB/s | 49 kB 00:00 2020-07-16T20:28:17.555 INFO:teuthology.orchestra.run.smithi041.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 3.6 MB/s | 59 kB 00:00 2020-07-16T20:28:17.573 INFO:teuthology.orchestra.run.smithi041.stdout:(114/137): python3-pecan-1.3.2-9.el8.noarch.rpm 16 MB/s | 283 kB 00:00 2020-07-16T20:28:17.589 INFO:teuthology.orchestra.run.smithi041.stdout:(115/137): python3-portend-2.6-1.el8.noarch.rpm 992 kB/s | 16 kB 00:00 2020-07-16T20:28:17.605 INFO:teuthology.orchestra.run.smithi041.stdout:(116/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.9 MB/s | 48 kB 00:00 2020-07-16T20:28:17.621 INFO:teuthology.orchestra.run.smithi041.stdout:(117/137): python3-repoze-lru-0.7-6.el8.noarch. 2.1 MB/s | 34 kB 00:00 2020-07-16T20:28:17.638 INFO:teuthology.orchestra.run.smithi041.stdout:(118/137): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2020-07-16T20:28:17.654 INFO:teuthology.orchestra.run.smithi041.stdout:(119/137): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-07-16T20:28:17.670 INFO:teuthology.orchestra.run.smithi041.stdout:(120/137): python3-simplegeneric-0.8.1-17.el8.n 1.2 MB/s | 19 kB 00:00 2020-07-16T20:28:17.686 INFO:teuthology.orchestra.run.smithi041.stdout:(121/137): python3-singledispatch-3.4.0.3-18.el 1.5 MB/s | 24 kB 00:00 2020-07-16T20:28:17.702 INFO:teuthology.orchestra.run.smithi041.stdout:(122/137): python3-tempora-1.14.1-5.el8.noarch. 1.8 MB/s | 29 kB 00:00 2020-07-16T20:28:17.718 INFO:teuthology.orchestra.run.smithi041.stdout:(123/137): python3-trustme-0.5.2-4.el8.noarch.r 1.7 MB/s | 26 kB 00:00 2020-07-16T20:28:17.735 INFO:teuthology.orchestra.run.smithi041.stdout:(124/137): python3-waitress-1.2.1-2.el8.1.noarc 14 MB/s | 241 kB 00:00 2020-07-16T20:28:17.754 INFO:teuthology.orchestra.run.smithi041.stdout:(125/137): python3-webob-1.8.5-1.el8.1.noarch.r 13 MB/s | 251 kB 00:00 2020-07-16T20:28:17.771 INFO:teuthology.orchestra.run.smithi041.stdout:(126/137): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-07-16T20:28:17.787 INFO:teuthology.orchestra.run.smithi041.stdout:(127/137): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-07-16T20:28:17.808 INFO:teuthology.orchestra.run.smithi041.stdout:(128/137): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-07-16T20:28:17.819 INFO:teuthology.orchestra.run.smithi041.stdout:(129/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-07-16T20:28:18.113 INFO:teuthology.orchestra.run.smithi041.stdout:(130/137): librados2-16.0.0-3565.g8e60ca350a5.e 13 MB/s | 3.7 MB 00:00 2020-07-16T20:28:18.231 INFO:teuthology.orchestra.run.smithi041.stdout:(131/137): librbd1-16.0.0-3565.g8e60ca350a5.el8 17 MB/s | 2.0 MB 00:00 2020-07-16T20:28:18.263 INFO:teuthology.orchestra.run.smithi041.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 67 MB/s | 2.1 MB 00:00 2020-07-16T20:28:18.285 INFO:teuthology.orchestra.run.smithi041.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 81 MB/s | 1.7 MB 00:00 2020-07-16T20:28:18.287 INFO:teuthology.orchestra.run.smithi041.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 54 MB/s | 133 kB 00:00 2020-07-16T20:28:18.291 INFO:teuthology.orchestra.run.smithi041.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 69 MB/s | 308 kB 00:00 2020-07-16T20:28:18.492 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-07-16T20:28:18.494 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-07-16T20:28:18.558 INFO:teuthology.orchestra.run.smithi041.stdout:(136/137): ceph-common-16.0.0-3565.g8e60ca350a5 2.3 MB/s | 22 MB 00:09 2020-07-16T20:28:22.675 INFO:teuthology.orchestra.run.smithi041.stdout:(137/137): ceph-test-16.0.0-3565.g8e60ca350a5.e 5.5 MB/s | 45 MB 00:08 2020-07-16T20:28:22.678 INFO:teuthology.orchestra.run.smithi041.stdout:-------------------------------------------------------------------------------- 2020-07-16T20:28:22.679 INFO:teuthology.orchestra.run.smithi041.stdout:Total 14 MB/s | 195 MB 00:13 2020-07-16T20:28:22.755 INFO:teuthology.orchestra.run.smithi041.stdout:Running transaction check 2020-07-16T20:28:22.955 INFO:teuthology.orchestra.run.smithi041.stdout:Transaction check succeeded. 2020-07-16T20:28:22.955 INFO:teuthology.orchestra.run.smithi041.stdout:Running transaction test 2020-07-16T20:28:23.576 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-07-16T20:28:23.779 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-07-16T20:28:23.995 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:24.111 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:24.274 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-07-16T20:28:24.421 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-07-16T20:28:24.573 INFO:teuthology.orchestra.run.smithi041.stdout:Transaction test succeeded. 2020-07-16T20:28:24.573 INFO:teuthology.orchestra.run.smithi041.stdout:Running transaction 2020-07-16T20:28:24.654 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-07-16T20:28:24.788 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:24.884 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:25.086 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-07-16T20:28:25.321 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:25.712 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:25.913 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:26.151 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:26.404 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:26.511 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:26.679 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:26.779 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:27.236 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 11/148 2020-07-16T20:28:27.396 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:27.586 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:27.834 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-07-16T20:28:28.049 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-07-16T20:28:28.247 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-07-16T20:28:28.500 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-07-16T20:28:28.655 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:29.045 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:29.337 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:29.413 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:29.611 INFO:teuthology.orchestra.run.smithi041.stdout: Preparing : 1/1 2020-07-16T20:28:29.719 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:29.816 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-07-16T20:28:29.962 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:30.021 INFO:teuthology.orchestra.run.smithi041.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:30.060 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:30.101 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:30.244 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-07-16T20:28:30.269 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-07-16T20:28:30.397 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-07-16T20:28:30.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-07-16T20:28:30.605 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-07-16T20:28:30.628 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-07-16T20:28:30.729 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:30.806 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:30.893 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-07-16T20:28:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-07-16T20:28:31.045 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:31.204 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:31.386 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:31.612 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:31.786 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:31.919 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:32.034 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:32.078 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:32.236 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:32.327 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:32.461 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:32.541 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:32.618 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:32.770 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:33.038 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 11/148 2020-07-16T20:28:33.178 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:33.358 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:33.467 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:33.625 INFO:teuthology.orchestra.run.smithi041.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-07-16T20:28:33.782 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-07-16T20:28:33.803 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-07-16T20:28:34.000 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-07-16T20:28:34.013 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-07-16T20:28:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-07-16T20:28:34.336 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-07-16T20:28:34.370 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:34.508 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-07-16T20:28:34.674 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 32/148 2020-07-16T20:28:34.739 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:34.901 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 33/148 2020-07-16T20:28:35.009 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:35.070 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:35.380 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:35.620 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:35.728 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:35.879 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/148 2020-07-16T20:28:36.018 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-07-16T20:28:36.178 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 35/148 2020-07-16T20:28:36.190 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-07-16T20:28:36.379 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-07-16T20:28:36.458 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 36/148 2020-07-16T20:28:36.559 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-07-16T20:28:36.661 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:36.711 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:36.863 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:37.003 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:37.578 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:37.719 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:38.298 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:38.427 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:38.605 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:38.930 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 38/148 2020-07-16T20:28:39.155 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 39/148 2020-07-16T20:28:39.175 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:39.388 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 40/148 2020-07-16T20:28:39.477 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-07-16T20:28:39.650 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/148 2020-07-16T20:28:39.684 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-07-16T20:28:39.866 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-07-16T20:28:40.033 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-07-16T20:28:40.166 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 32/148 2020-07-16T20:28:40.375 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 33/148 2020-07-16T20:28:40.502 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 42/148 2020-07-16T20:28:40.853 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 43/148 2020-07-16T20:28:41.024 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 44/148 2020-07-16T20:28:41.256 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 45/148 2020-07-16T20:28:41.356 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/148 2020-07-16T20:28:41.419 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 46/148 2020-07-16T20:28:41.611 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-07-16T20:28:41.744 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 35/148 2020-07-16T20:28:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/148 2020-07-16T20:28:42.011 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 36/148 2020-07-16T20:28:42.143 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 49/148 2020-07-16T20:28:42.201 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:42.317 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 50/148 2020-07-16T20:28:42.490 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/148 2020-07-16T20:28:42.647 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/148 2020-07-16T20:28:42.882 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/148 2020-07-16T20:28:43.130 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/148 2020-07-16T20:28:43.305 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/148 2020-07-16T20:28:43.466 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/148 2020-07-16T20:28:43.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/148 2020-07-16T20:28:43.838 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 58/148 2020-07-16T20:28:43.999 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/148 2020-07-16T20:28:44.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/148 2020-07-16T20:28:44.333 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:44.479 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 61/148 2020-07-16T20:28:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 38/148 2020-07-16T20:28:44.676 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/148 2020-07-16T20:28:44.828 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 39/148 2020-07-16T20:28:44.834 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/148 2020-07-16T20:28:45.042 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/148 2020-07-16T20:28:45.083 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 40/148 2020-07-16T20:28:45.242 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/148 2020-07-16T20:28:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/148 2020-07-16T20:28:45.459 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/148 2020-07-16T20:28:45.589 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 42/148 2020-07-16T20:28:45.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/148 2020-07-16T20:28:45.777 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 43/148 2020-07-16T20:28:45.954 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 44/148 2020-07-16T20:28:45.956 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/148 2020-07-16T20:28:46.173 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 45/148 2020-07-16T20:28:46.196 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 69/148 2020-07-16T20:28:46.335 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 46/148 2020-07-16T20:28:46.408 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/148 2020-07-16T20:28:46.551 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-07-16T20:28:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 71/148 2020-07-16T20:28:46.815 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/148 2020-07-16T20:28:46.847 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 72/148 2020-07-16T20:28:47.094 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 49/148 2020-07-16T20:28:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 73/148 2020-07-16T20:28:47.234 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 50/148 2020-07-16T20:28:47.373 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 74/148 2020-07-16T20:28:47.390 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/148 2020-07-16T20:28:47.547 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/148 2020-07-16T20:28:47.564 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 75/148 2020-07-16T20:28:47.764 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/148 2020-07-16T20:28:48.007 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/148 2020-07-16T20:28:48.188 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/148 2020-07-16T20:28:48.343 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/148 2020-07-16T20:28:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/148 2020-07-16T20:28:48.633 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/148 2020-07-16T20:28:48.718 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 58/148 2020-07-16T20:28:48.887 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 77/148 2020-07-16T20:28:48.919 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/148 2020-07-16T20:28:49.087 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 78/148 2020-07-16T20:28:49.154 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/148 2020-07-16T20:28:49.363 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 61/148 2020-07-16T20:28:49.403 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 79/148 2020-07-16T20:28:49.518 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/148 2020-07-16T20:28:49.611 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 80/148 2020-07-16T20:28:49.685 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/148 2020-07-16T20:28:49.741 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/148 2020-07-16T20:28:49.871 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/148 2020-07-16T20:28:49.905 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 82/148 2020-07-16T20:28:50.062 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/148 2020-07-16T20:28:50.233 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 83/148 2020-07-16T20:28:50.259 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/148 2020-07-16T20:28:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/148 2020-07-16T20:28:50.504 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 84/148 2020-07-16T20:28:50.654 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 85/148 2020-07-16T20:28:50.768 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/148 2020-07-16T20:28:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 86/148 2020-07-16T20:28:50.996 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 69/148 2020-07-16T20:28:51.142 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 87/148 2020-07-16T20:28:51.143 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 88/148 2020-07-16T20:28:51.143 INFO:teuthology.orchestra.run.smithi157.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-07-16T20:28:51.144 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:28:51.175 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/148 2020-07-16T20:28:51.366 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 71/148 2020-07-16T20:28:51.545 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-12.el8.x86_64 89/148 2020-07-16T20:28:51.593 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 72/148 2020-07-16T20:28:51.799 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 90/148 2020-07-16T20:28:51.849 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 73/148 2020-07-16T20:28:52.031 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 91/148 2020-07-16T20:28:52.041 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 74/148 2020-07-16T20:28:52.208 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 75/148 2020-07-16T20:28:52.411 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 92/148 2020-07-16T20:28:52.698 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 93/148 2020-07-16T20:28:53.018 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 94/148 2020-07-16T20:28:53.292 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 95/148 2020-07-16T20:28:53.371 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/148 2020-07-16T20:28:53.490 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/148 2020-07-16T20:28:53.613 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 77/148 2020-07-16T20:28:53.674 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/148 2020-07-16T20:28:53.800 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 78/148 2020-07-16T20:28:53.894 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/148 2020-07-16T20:28:54.066 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:54.102 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 79/148 2020-07-16T20:28:54.150 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:54.286 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 80/148 2020-07-16T20:28:54.416 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/148 2020-07-16T20:28:54.456 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.5-12.el8.x86_64 100/148 2020-07-16T20:28:54.562 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 82/148 2020-07-16T20:28:54.726 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.1-6.el8.noarch 101/148 2020-07-16T20:28:54.833 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 83/148 2020-07-16T20:28:54.848 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 102/148 2020-07-16T20:28:55.036 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 103/148 2020-07-16T20:28:55.088 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 84/148 2020-07-16T20:28:55.275 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 104/148 2020-07-16T20:28:55.281 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 85/148 2020-07-16T20:28:55.455 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 86/148 2020-07-16T20:28:55.686 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 87/148 2020-07-16T20:28:55.686 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 88/148 2020-07-16T20:28:55.687 INFO:teuthology.orchestra.run.smithi041.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-07-16T20:28:55.687 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:28:56.072 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : fuse-2.9.7-12.el8.x86_64 89/148 2020-07-16T20:28:56.296 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 90/148 2020-07-16T20:28:56.517 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 91/148 2020-07-16T20:28:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 92/148 2020-07-16T20:28:57.227 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 93/148 2020-07-16T20:28:57.571 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 94/148 2020-07-16T20:28:57.834 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 95/148 2020-07-16T20:28:58.017 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/148 2020-07-16T20:28:58.182 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/148 2020-07-16T20:28:58.346 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/148 2020-07-16T20:28:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:58.650 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:58.943 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : jq-1.5-12.el8.x86_64 100/148 2020-07-16T20:28:59.095 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:59.201 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : automake-1.16.1-6.el8.noarch 101/148 2020-07-16T20:28:59.324 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 102/148 2020-07-16T20:28:59.374 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:59.532 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 103/148 2020-07-16T20:28:59.775 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 104/148 2020-07-16T20:29:00.109 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:29:00.456 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:29:00.535 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:29:00.682 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:29:03.680 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:29:03.933 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:29:04.690 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:29:05.000 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:29:05.073 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:29:05.190 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:29:17.550 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:29:17.552 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2020-07-16T20:29:17.552 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2020-07-16T20:29:17.553 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2020-07-16T20:29:17.554 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2020-07-16T20:29:17.557 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2020-07-16T20:29:17.569 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2020-07-16T20:29:17.570 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2020-07-16T20:29:17.575 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2020-07-16T20:29:17.575 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2020-07-16T20:29:17.575 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:17.975 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:18.391 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:18.594 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:20.110 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:20.371 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:20.396 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:21.821 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:21.993 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:22.195 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:22.519 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:29:22.519 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /sys 2020-07-16T20:29:22.520 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /proc 2020-07-16T20:29:22.520 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /dev 2020-07-16T20:29:22.521 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /run 2020-07-16T20:29:22.521 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /mnt 2020-07-16T20:29:22.521 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /var/tmp 2020-07-16T20:29:22.522 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /home 2020-07-16T20:29:22.522 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /tmp 2020-07-16T20:29:22.522 INFO:teuthology.orchestra.run.smithi041.stdout:skipping the directory /dev 2020-07-16T20:29:22.523 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:22.905 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:23.065 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:23.327 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:23.354 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:23.563 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:24.368 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:24.570 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:24.640 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:25.184 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:25.380 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:25.405 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:25.430 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 115/148 2020-07-16T20:29:25.674 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:25.702 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:25.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:25.881 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:26.843 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:26.952 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 118/148 2020-07-16T20:29:26.996 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:27.204 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:27.211 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:27.543 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:27.744 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:28.136 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:28.529 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:29.640 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:29.929 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:30.007 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:30.891 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 115/148 2020-07-16T20:29:31.096 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:31.253 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:31.857 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:32.221 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 121/148 2020-07-16T20:29:32.341 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 118/148 2020-07-16T20:29:32.393 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:32.454 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:32.529 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:32.875 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:33.212 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:33.349 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 123/148 2020-07-16T20:29:33.609 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-07-16T20:29:33.779 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-07-16T20:29:33.988 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 126/148 2020-07-16T20:29:34.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-07-16T20:29:34.402 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-07-16T20:29:34.792 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-07-16T20:29:35.178 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-07-16T20:29:35.384 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 131/148 2020-07-16T20:29:35.619 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 132/148 2020-07-16T20:29:35.802 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:35.918 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:36.185 INFO:teuthology.orchestra.run.smithi157.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-07-16T20:29:36.417 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-07-16T20:29:36.609 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:36.692 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:36.891 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:36.902 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:37.102 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-07-16T20:29:37.269 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-07-16T20:29:37.463 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-07-16T20:29:37.586 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:37.629 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-07-16T20:29:37.879 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-07-16T20:29:37.880 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:37.914 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 121/148 2020-07-16T20:29:38.053 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:38.103 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:38.117 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:38.286 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:38.303 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:38.303 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:38.555 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:38.556 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:38.828 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:38.829 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:39.037 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 123/148 2020-07-16T20:29:39.120 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:39.120 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:39.301 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-07-16T20:29:39.464 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-07-16T20:29:39.638 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 126/148 2020-07-16T20:29:39.976 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:39.976 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-07-16T20:29:39.976 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-07-16T20:29:39.976 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-07-16T20:29:39.977 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-07-16T20:29:39.977 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-07-16T20:29:39.977 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-07-16T20:29:39.977 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-07-16T20:29:39.977 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-07-16T20:29:39.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-07-16T20:29:39.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-07-16T20:29:39.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 11/148 2020-07-16T20:29:39.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:29:39.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 13/148 2020-07-16T20:29:39.979 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 14/148 2020-07-16T20:29:39.979 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 15/148 2020-07-16T20:29:39.979 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 16/148 2020-07-16T20:29:39.979 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 17/148 2020-07-16T20:29:39.979 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 18/148 2020-07-16T20:29:39.980 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 19/148 2020-07-16T20:29:39.980 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 20/148 2020-07-16T20:29:39.980 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 21/148 2020-07-16T20:29:39.980 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 22/148 2020-07-16T20:29:39.980 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 23/148 2020-07-16T20:29:39.981 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 24/148 2020-07-16T20:29:39.981 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 25/148 2020-07-16T20:29:39.981 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 26/148 2020-07-16T20:29:39.981 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 27/148 2020-07-16T20:29:39.991 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-07-16T20:29:39.991 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 28/148 2020-07-16T20:29:39.991 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 29/148 2020-07-16T20:29:39.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 30/148 2020-07-16T20:29:39.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 31/148 2020-07-16T20:29:39.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 32/148 2020-07-16T20:29:39.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 33/148 2020-07-16T20:29:39.992 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 34/148 2020-07-16T20:29:39.993 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 35/148 2020-07-16T20:29:39.993 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 36/148 2020-07-16T20:29:39.993 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 37/148 2020-07-16T20:29:39.993 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 38/148 2020-07-16T20:29:39.993 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 39/148 2020-07-16T20:29:39.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 40/148 2020-07-16T20:29:39.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 41/148 2020-07-16T20:29:39.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 42/148 2020-07-16T20:29:39.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 43/148 2020-07-16T20:29:39.994 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 44/148 2020-07-16T20:29:39.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-07-16T20:29:39.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-07-16T20:29:39.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-07-16T20:29:39.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-07-16T20:29:39.995 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-07-16T20:29:39.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-07-16T20:29:39.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-07-16T20:29:39.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-07-16T20:29:39.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-07-16T20:29:39.996 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-07-16T20:29:39.997 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-07-16T20:29:39.997 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-07-16T20:29:39.997 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-07-16T20:29:39.997 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-07-16T20:29:39.997 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-07-16T20:29:39.998 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-07-16T20:29:39.999 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-07-16T20:29:39.999 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-07-16T20:29:39.999 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-07-16T20:29:39.999 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-07-16T20:29:39.999 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-07-16T20:29:40.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-07-16T20:29:40.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-07-16T20:29:40.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-07-16T20:29:40.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-07-16T20:29:40.000 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-07-16T20:29:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-07-16T20:29:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-07-16T20:29:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-07-16T20:29:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-07-16T20:29:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-07-16T20:29:40.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-07-16T20:29:40.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-07-16T20:29:40.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-07-16T20:29:40.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-07-16T20:29:40.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-07-16T20:29:40.003 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-07-16T20:29:40.004 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-07-16T20:29:40.004 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-07-16T20:29:40.004 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-07-16T20:29:40.004 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-07-16T20:29:40.004 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-07-16T20:29:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-07-16T20:29:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-07-16T20:29:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-07-16T20:29:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-07-16T20:29:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-07-16T20:29:40.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-07-16T20:29:40.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-07-16T20:29:40.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-07-16T20:29:40.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-07-16T20:29:40.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-07-16T20:29:40.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-07-16T20:29:40.008 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-07-16T20:29:40.008 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-07-16T20:29:40.008 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-07-16T20:29:40.008 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-07-16T20:29:40.008 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-07-16T20:29:40.009 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-07-16T20:29:40.010 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-07-16T20:29:40.010 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-07-16T20:29:40.010 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 126/148 2020-07-16T20:29:40.010 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-07-16T20:29:40.010 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-07-16T20:29:40.011 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-07-16T20:29:40.011 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 130/148 2020-07-16T20:29:40.011 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-07-16T20:29:40.011 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-07-16T20:29:40.011 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 137/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-07-16T20:29:40.012 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 139/148 2020-07-16T20:29:40.013 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-07-16T20:29:40.013 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-07-16T20:29:40.013 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-07-16T20:29:40.013 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-07-16T20:29:40.013 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:40.014 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-07-16T20:29:40.014 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:40.014 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-07-16T20:29:40.158 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-07-16T20:29:40.566 INFO:teuthology.orchestra.run.smithi041.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-07-16T20:29:40.861 INFO:teuthology.orchestra.run.smithi041.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-07-16T20:29:41.052 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 131/148 2020-07-16T20:29:41.264 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 132/148 2020-07-16T20:29:41.469 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:41.582 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:41.838 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-07-16T20:29:41.839 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:41.839 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2020-07-16T20:29:41.840 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.840 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.840 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:41.841 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:41.841 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:41.841 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:41.842 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:41.842 INFO:teuthology.orchestra.run.smithi157.stdout:Downgraded: 2020-07-16T20:29:41.842 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-07-16T20:29:41.843 INFO:teuthology.orchestra.run.smithi157.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:41.843 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:41.843 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:41.844 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-07-16T20:29:41.844 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.844 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.845 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.845 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.845 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.846 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.846 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.846 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.847 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.847 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.847 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.849 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.849 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.850 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.850 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.851 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.852 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.0.4-10.el8.x86_64 2020-07-16T20:29:41.852 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.1-9.el8.x86_64 2020-07-16T20:29:41.852 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-25.el8.x86_64 2020-07-16T20:29:41.853 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-07-16T20:29:41.853 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-07-16T20:29:41.854 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-07-16T20:29:41.854 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:41.854 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-07-16T20:29:41.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-07-16T20:29:41.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-07-16T20:29:41.855 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.856 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.856 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.856 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.857 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.857 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.857 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.858 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.858 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:41.858 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.859 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.859 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:41.859 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.1-6.el8.noarch 2020-07-16T20:29:41.860 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.5-12.el8.x86_64 2020-07-16T20:29:41.860 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-07-16T20:29:41.860 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-07-16T20:29:41.860 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-07-16T20:29:41.861 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.3-2.el8.x86_64 2020-07-16T20:29:41.861 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-07-16T20:29:41.861 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-5.el8.noarch 2020-07-16T20:29:41.862 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-07-16T20:29:41.862 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-07-16T20:29:41.862 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-16T20:29:41.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-07-16T20:29:41.863 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2020-07-16T20:29:41.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-07-16T20:29:41.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:41.864 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:41.865 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-07-16T20:29:41.865 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-07-16T20:29:41.865 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-07-16T20:29:41.865 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2020-07-16T20:29:41.866 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-07-16T20:29:41.866 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-07-16T20:29:41.866 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-07-16T20:29:41.867 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.3.2-6.el8.x86_64 2020-07-16T20:29:41.867 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.7-12.el8.x86_64 2020-07-16T20:29:41.867 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-07-16T20:29:41.868 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-07-16T20:29:41.868 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel-1.17-9.el8.x86_64 2020-07-16T20:29:41.868 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-07-16T20:29:41.869 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:41.869 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:41.869 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-07-16T20:29:41.870 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-07-16T20:29:41.870 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-07-16T20:29:41.870 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-07-16T20:29:41.870 INFO:teuthology.orchestra.run.smithi157.stdout: libxslt-1.1.32-3.el8.x86_64 2020-07-16T20:29:41.870 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-07-16T20:29:41.871 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-07-16T20:29:41.871 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-07-16T20:29:41.871 INFO:teuthology.orchestra.run.smithi157.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-07-16T20:29:41.871 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-07-16T20:29:41.871 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-07-16T20:29:41.872 INFO:teuthology.orchestra.run.smithi157.stdout: fmt-6.2.1-1.el8.x86_64 2020-07-16T20:29:41.873 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-07-16T20:29:41.873 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb-1.22-1.el8.x86_64 2020-07-16T20:29:41.873 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2020-07-16T20:29:41.873 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2020-07-16T20:29:41.874 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg-1.5-6.el8.noarch 2020-07-16T20:29:41.874 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-07-16T20:29:41.874 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-07-16T20:29:41.874 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-07-16T20:29:41.874 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-07-16T20:29:41.875 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-07-16T20:29:41.875 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-07-16T20:29:41.875 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-07-16T20:29:41.875 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-07-16T20:29:41.876 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2020-07-16T20:29:41.876 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-07-16T20:29:41.876 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-07-16T20:29:41.876 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-16T20:29:41.876 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2020-07-16T20:29:41.877 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-07-16T20:29:41.878 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-07-16T20:29:41.878 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-07-16T20:29:41.878 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-07-16T20:29:41.879 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-07-16T20:29:41.879 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-07-16T20:29:41.879 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-07-16T20:29:41.880 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-07-16T20:29:41.880 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-07-16T20:29:41.880 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-07-16T20:29:41.881 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-07-16T20:29:41.881 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:41.882 INFO:teuthology.orchestra.run.smithi041.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-07-16T20:29:41.882 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-07-16T20:29:42.016 DEBUG:teuthology.parallel:result is None 2020-07-16T20:29:42.048 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-07-16T20:29:42.210 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:42.296 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:42.469 INFO:teuthology.orchestra.run.smithi041.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:42.489 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:42.687 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-07-16T20:29:42.812 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-07-16T20:29:42.956 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-07-16T20:29:43.140 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-07-16T20:29:43.355 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-07-16T20:29:43.356 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:43.571 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:43.687 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:43.701 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:43.702 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:43.939 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:43.940 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:44.167 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:44.168 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:44.372 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:44.372 INFO:teuthology.orchestra.run.smithi041.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:45.322 INFO:teuthology.orchestra.run.smithi041.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:45.323 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-07-16T20:29:45.323 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-07-16T20:29:45.323 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-07-16T20:29:45.323 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-07-16T20:29:45.323 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-07-16T20:29:45.324 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-07-16T20:29:45.324 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-07-16T20:29:45.324 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-07-16T20:29:45.324 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-07-16T20:29:45.324 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-07-16T20:29:45.325 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 11/148 2020-07-16T20:29:45.325 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:29:45.325 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 13/148 2020-07-16T20:29:45.325 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 14/148 2020-07-16T20:29:45.325 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 15/148 2020-07-16T20:29:45.326 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 16/148 2020-07-16T20:29:45.326 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 17/148 2020-07-16T20:29:45.326 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 18/148 2020-07-16T20:29:45.326 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 19/148 2020-07-16T20:29:45.326 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 20/148 2020-07-16T20:29:45.327 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 21/148 2020-07-16T20:29:45.327 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 22/148 2020-07-16T20:29:45.327 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 23/148 2020-07-16T20:29:45.327 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 24/148 2020-07-16T20:29:45.327 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 25/148 2020-07-16T20:29:45.328 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 26/148 2020-07-16T20:29:45.328 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 27/148 2020-07-16T20:29:45.328 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 28/148 2020-07-16T20:29:45.328 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 29/148 2020-07-16T20:29:45.352 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 30/148 2020-07-16T20:29:45.353 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 31/148 2020-07-16T20:29:45.353 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 32/148 2020-07-16T20:29:45.353 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 33/148 2020-07-16T20:29:45.354 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 34/148 2020-07-16T20:29:45.354 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 35/148 2020-07-16T20:29:45.354 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 36/148 2020-07-16T20:29:45.355 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 37/148 2020-07-16T20:29:45.355 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 38/148 2020-07-16T20:29:45.355 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 39/148 2020-07-16T20:29:45.356 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 40/148 2020-07-16T20:29:45.356 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 41/148 2020-07-16T20:29:45.356 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 42/148 2020-07-16T20:29:45.357 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 43/148 2020-07-16T20:29:45.357 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 44/148 2020-07-16T20:29:45.357 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-07-16T20:29:45.358 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-07-16T20:29:45.358 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-07-16T20:29:45.358 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-07-16T20:29:45.359 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-07-16T20:29:45.359 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-07-16T20:29:45.360 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-07-16T20:29:45.360 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-07-16T20:29:45.360 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-07-16T20:29:45.361 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-07-16T20:29:45.361 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-07-16T20:29:45.361 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-07-16T20:29:45.363 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-07-16T20:29:45.363 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-07-16T20:29:45.363 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-07-16T20:29:45.364 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-07-16T20:29:45.364 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-07-16T20:29:45.364 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-07-16T20:29:45.365 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-07-16T20:29:45.365 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-07-16T20:29:45.365 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-07-16T20:29:45.366 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-07-16T20:29:45.366 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-07-16T20:29:45.366 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-07-16T20:29:45.367 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-07-16T20:29:45.367 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-07-16T20:29:45.367 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-07-16T20:29:45.368 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-07-16T20:29:45.368 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-07-16T20:29:45.368 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-07-16T20:29:45.369 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-07-16T20:29:45.369 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-07-16T20:29:45.369 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-07-16T20:29:45.369 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-07-16T20:29:45.370 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-07-16T20:29:45.370 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-07-16T20:29:45.371 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-07-16T20:29:45.372 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-07-16T20:29:45.372 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-07-16T20:29:45.373 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-07-16T20:29:45.373 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-07-16T20:29:45.373 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-07-16T20:29:45.374 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-07-16T20:29:45.374 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-07-16T20:29:45.374 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-07-16T20:29:45.374 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-07-16T20:29:45.374 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-07-16T20:29:45.375 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-07-16T20:29:45.375 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-07-16T20:29:45.375 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-07-16T20:29:45.375 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-07-16T20:29:45.375 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-07-16T20:29:45.376 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-07-16T20:29:45.376 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-07-16T20:29:45.376 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-07-16T20:29:45.376 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-07-16T20:29:45.376 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-07-16T20:29:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-07-16T20:29:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-07-16T20:29:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-07-16T20:29:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-07-16T20:29:45.377 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-07-16T20:29:45.378 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-07-16T20:29:45.378 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-07-16T20:29:45.378 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-07-16T20:29:45.388 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-07-16T20:29:45.389 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-07-16T20:29:45.389 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-07-16T20:29:45.389 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-07-16T20:29:45.389 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-07-16T20:29:45.389 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-07-16T20:29:45.390 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-07-16T20:29:45.390 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-07-16T20:29:45.390 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-07-16T20:29:45.390 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-07-16T20:29:45.390 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-07-16T20:29:45.391 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 126/148 2020-07-16T20:29:45.391 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-07-16T20:29:45.391 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-07-16T20:29:45.391 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-07-16T20:29:45.391 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 130/148 2020-07-16T20:29:45.392 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-07-16T20:29:45.392 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-07-16T20:29:45.392 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-07-16T20:29:45.392 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-07-16T20:29:45.392 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 137/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 139/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-07-16T20:29:45.393 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-07-16T20:29:45.394 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-07-16T20:29:45.394 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-07-16T20:29:45.394 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:45.395 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-07-16T20:29:45.395 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:45.395 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-07-16T20:29:47.118 INFO:teuthology.orchestra.run.smithi041.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-07-16T20:29:47.119 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:47.119 INFO:teuthology.orchestra.run.smithi041.stdout:Upgraded: 2020-07-16T20:29:47.119 INFO:teuthology.orchestra.run.smithi041.stdout: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.120 INFO:teuthology.orchestra.run.smithi041.stdout: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.120 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:47.120 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:47.120 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:47.121 INFO:teuthology.orchestra.run.smithi041.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:47.121 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:47.121 INFO:teuthology.orchestra.run.smithi041.stdout:Downgraded: 2020-07-16T20:29:47.121 INFO:teuthology.orchestra.run.smithi041.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-07-16T20:29:47.121 INFO:teuthology.orchestra.run.smithi041.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:47.122 INFO:teuthology.orchestra.run.smithi041.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:47.122 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:47.122 INFO:teuthology.orchestra.run.smithi041.stdout:Installed: 2020-07-16T20:29:47.122 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.123 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.123 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.124 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-immutable-object-cache-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.124 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.124 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.124 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.125 INFO:teuthology.orchestra.run.smithi041.stdout: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.125 INFO:teuthology.orchestra.run.smithi041.stdout: libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.125 INFO:teuthology.orchestra.run.smithi041.stdout: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.125 INFO:teuthology.orchestra.run.smithi041.stdout: librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.126 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.126 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.126 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.126 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.126 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.127 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.127 INFO:teuthology.orchestra.run.smithi041.stdout: rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.127 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.127 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.127 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.128 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.128 INFO:teuthology.orchestra.run.smithi041.stdout: bison-3.0.4-10.el8.x86_64 2020-07-16T20:29:47.128 INFO:teuthology.orchestra.run.smithi041.stdout: flex-2.6.1-9.el8.x86_64 2020-07-16T20:29:47.128 INFO:teuthology.orchestra.run.smithi041.stdout: libtool-2.4.6-25.el8.x86_64 2020-07-16T20:29:47.128 INFO:teuthology.orchestra.run.smithi041.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-07-16T20:29:47.129 INFO:teuthology.orchestra.run.smithi041.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-07-16T20:29:47.129 INFO:teuthology.orchestra.run.smithi041.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-07-16T20:29:47.129 INFO:teuthology.orchestra.run.smithi041.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:47.129 INFO:teuthology.orchestra.run.smithi041.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-07-16T20:29:47.131 INFO:teuthology.orchestra.run.smithi041.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-07-16T20:29:47.132 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-07-16T20:29:47.132 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.133 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.133 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.133 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.134 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.134 INFO:teuthology.orchestra.run.smithi041.stdout: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.135 INFO:teuthology.orchestra.run.smithi041.stdout: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.135 INFO:teuthology.orchestra.run.smithi041.stdout: python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.135 INFO:teuthology.orchestra.run.smithi041.stdout: python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:47.136 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.136 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.136 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:47.137 INFO:teuthology.orchestra.run.smithi041.stdout: automake-1.16.1-6.el8.noarch 2020-07-16T20:29:47.137 INFO:teuthology.orchestra.run.smithi041.stdout: jq-1.5-12.el8.x86_64 2020-07-16T20:29:47.137 INFO:teuthology.orchestra.run.smithi041.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-07-16T20:29:47.138 INFO:teuthology.orchestra.run.smithi041.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-07-16T20:29:47.138 INFO:teuthology.orchestra.run.smithi041.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-07-16T20:29:47.138 INFO:teuthology.orchestra.run.smithi041.stdout: openblas-0.3.3-2.el8.x86_64 2020-07-16T20:29:47.139 INFO:teuthology.orchestra.run.smithi041.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-07-16T20:29:47.139 INFO:teuthology.orchestra.run.smithi041.stdout: python3-babel-2.5.1-5.el8.noarch 2020-07-16T20:29:47.139 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-07-16T20:29:47.140 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-07-16T20:29:47.140 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-16T20:29:47.140 INFO:teuthology.orchestra.run.smithi041.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-07-16T20:29:47.141 INFO:teuthology.orchestra.run.smithi041.stdout: python3-mako-1.0.6-13.el8.noarch 2020-07-16T20:29:47.141 INFO:teuthology.orchestra.run.smithi041.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-07-16T20:29:47.142 INFO:teuthology.orchestra.run.smithi041.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:47.142 INFO:teuthology.orchestra.run.smithi041.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:47.142 INFO:teuthology.orchestra.run.smithi041.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-07-16T20:29:47.143 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-07-16T20:29:47.143 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-07-16T20:29:47.143 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pytz-2017.2-9.el8.noarch 2020-07-16T20:29:47.144 INFO:teuthology.orchestra.run.smithi041.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-07-16T20:29:47.144 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-07-16T20:29:47.144 INFO:teuthology.orchestra.run.smithi041.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-07-16T20:29:47.145 INFO:teuthology.orchestra.run.smithi041.stdout: socat-1.7.3.2-6.el8.x86_64 2020-07-16T20:29:47.145 INFO:teuthology.orchestra.run.smithi041.stdout: fuse-2.9.7-12.el8.x86_64 2020-07-16T20:29:47.145 INFO:teuthology.orchestra.run.smithi041.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-07-16T20:29:47.146 INFO:teuthology.orchestra.run.smithi041.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-07-16T20:29:47.146 INFO:teuthology.orchestra.run.smithi041.stdout: krb5-devel-1.17-9.el8.x86_64 2020-07-16T20:29:47.146 INFO:teuthology.orchestra.run.smithi041.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-07-16T20:29:47.147 INFO:teuthology.orchestra.run.smithi041.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:47.147 INFO:teuthology.orchestra.run.smithi041.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:47.147 INFO:teuthology.orchestra.run.smithi041.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-07-16T20:29:47.148 INFO:teuthology.orchestra.run.smithi041.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-07-16T20:29:47.148 INFO:teuthology.orchestra.run.smithi041.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-07-16T20:29:47.148 INFO:teuthology.orchestra.run.smithi041.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-07-16T20:29:47.149 INFO:teuthology.orchestra.run.smithi041.stdout: libxslt-1.1.32-3.el8.x86_64 2020-07-16T20:29:47.149 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-07-16T20:29:47.150 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-07-16T20:29:47.150 INFO:teuthology.orchestra.run.smithi041.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-07-16T20:29:47.150 INFO:teuthology.orchestra.run.smithi041.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-07-16T20:29:47.151 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-07-16T20:29:47.151 INFO:teuthology.orchestra.run.smithi041.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-07-16T20:29:47.151 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-07-16T20:29:47.152 INFO:teuthology.orchestra.run.smithi041.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-07-16T20:29:47.152 INFO:teuthology.orchestra.run.smithi041.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-07-16T20:29:47.152 INFO:teuthology.orchestra.run.smithi041.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-07-16T20:29:47.153 INFO:teuthology.orchestra.run.smithi041.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-07-16T20:29:47.153 INFO:teuthology.orchestra.run.smithi041.stdout: fmt-6.2.1-1.el8.x86_64 2020-07-16T20:29:47.154 INFO:teuthology.orchestra.run.smithi041.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-07-16T20:29:47.154 INFO:teuthology.orchestra.run.smithi041.stdout: leveldb-1.22-1.el8.x86_64 2020-07-16T20:29:47.154 INFO:teuthology.orchestra.run.smithi041.stdout: liboath-2.6.2-3.el8.x86_64 2020-07-16T20:29:47.155 INFO:teuthology.orchestra.run.smithi041.stdout: libunwind-1.3.1-3.el8.x86_64 2020-07-16T20:29:47.158 INFO:teuthology.orchestra.run.smithi041.stdout: python3-apipkg-1.5-6.el8.noarch 2020-07-16T20:29:47.158 INFO:teuthology.orchestra.run.smithi041.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-07-16T20:29:47.159 INFO:teuthology.orchestra.run.smithi041.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-07-16T20:29:47.166 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-07-16T20:29:47.166 INFO:teuthology.orchestra.run.smithi041.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-07-16T20:29:47.166 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-07-16T20:29:47.167 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-07-16T20:29:47.167 INFO:teuthology.orchestra.run.smithi041.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-07-16T20:29:47.167 INFO:teuthology.orchestra.run.smithi041.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-07-16T20:29:47.168 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jaraco-6.2-6.el8.noarch 2020-07-16T20:29:47.168 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-07-16T20:29:47.168 INFO:teuthology.orchestra.run.smithi041.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-07-16T20:29:47.169 INFO:teuthology.orchestra.run.smithi041.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-16T20:29:47.255 INFO:teuthology.orchestra.run.smithi041.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-07-16T20:29:47.256 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-07-16T20:29:47.256 INFO:teuthology.orchestra.run.smithi041.stdout: python3-portend-2.6-1.el8.noarch 2020-07-16T20:29:47.256 INFO:teuthology.orchestra.run.smithi041.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-07-16T20:29:47.256 INFO:teuthology.orchestra.run.smithi041.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-07-16T20:29:47.256 INFO:teuthology.orchestra.run.smithi041.stdout: python3-routes-2.4.1-12.el8.noarch 2020-07-16T20:29:47.257 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-07-16T20:29:47.257 INFO:teuthology.orchestra.run.smithi041.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-07-16T20:29:47.257 INFO:teuthology.orchestra.run.smithi041.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-07-16T20:29:47.257 INFO:teuthology.orchestra.run.smithi041.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-07-16T20:29:47.257 INFO:teuthology.orchestra.run.smithi041.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-07-16T20:29:47.258 INFO:teuthology.orchestra.run.smithi041.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-07-16T20:29:47.258 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-07-16T20:29:47.258 INFO:teuthology.orchestra.run.smithi041.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-07-16T20:29:47.258 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-07-16T20:29:47.258 INFO:teuthology.orchestra.run.smithi041.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-07-16T20:29:47.259 INFO:teuthology.orchestra.run.smithi041.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-07-16T20:29:47.259 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:47.259 INFO:teuthology.orchestra.run.smithi041.stdout:Complete! 2020-07-16T20:29:47.570 DEBUG:teuthology.parallel:result is None 2020-07-16T20:29:47.571 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-07-16T20:29:47.628 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS 2020-07-16T20:29:47.629 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:29:47.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:29:47.942 INFO:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-07-16T20:29:47.967 INFO:teuthology.orchestra.run.smithi157.stdout:16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:47.968 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:47.969 INFO:teuthology.task.install:The correct ceph version 16.0.0-3565.g8e60ca350a5 is installed. 2020-07-16T20:29:47.969 INFO:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2020-07-16T20:29:48.026 INFO:teuthology.orchestra.run.smithi041.stdout:CentOS 2020-07-16T20:29:48.027 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:29:48.028 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:29:48.256 INFO:teuthology.orchestra.run.smithi041:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-07-16T20:29:48.277 INFO:teuthology.orchestra.run.smithi041.stdout:16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:48.277 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:48.278 INFO:teuthology.task.install:The correct ceph version 16.0.0-3565.g8e60ca350a5 is installed. 2020-07-16T20:29:48.279 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-07-16T20:29:48.280 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-16T20:29:48.321 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-16T20:29:48.356 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-07-16T20:29:48.357 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-16T20:29:48.393 INFO:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-16T20:29:48.462 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-16T20:29:48.498 INFO:teuthology.orchestra.run.smithi041:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-16T20:29:48.571 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-07-16T20:29:48.571 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-16T20:29:48.618 INFO:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-16T20:29:48.693 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-16T20:29:48.750 INFO:teuthology.orchestra.run.smithi041:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-16T20:29:48.821 INFO:teuthology.run_tasks:Running task ceph... 2020-07-16T20:29:48.949 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-07-16T20:29:48.951 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 777 /var/log/ceph 2020-07-16T20:29:48.954 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2020-07-16T20:29:48.985 INFO:tasks.ceph:Disabling ceph logrotate... 2020-07-16T20:29:48.986 INFO:teuthology.orchestra.run.smithi041:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-16T20:29:49.025 INFO:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-16T20:29:49.055 INFO:tasks.ceph:Creating extra log directories... 2020-07-16T20:29:49.056 INFO:teuthology.orchestra.run.smithi041:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-16T20:29:49.098 INFO:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-16T20:29:49.132 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-07-16T20:29:49.132 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-07-16T20:29:49.133 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-07-16T20:29:49.134 INFO:teuthology.orchestra.run.smithi157:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-07-16T20:29:49.247 INFO:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:49.409 INFO:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:49.453 INFO:teuthology.orchestra.run.smithi041:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-07-16T20:29:49.519 INFO:teuthology.orchestra.run.smithi041:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:49.659 INFO:teuthology.orchestra.run.smithi041:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:49.695 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-07-16T20:29:49.696 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-07-16T20:29:49.696 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231371', 'branch': 'wip-pdonnell-testing-20200716.140830', 'description': 'fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_trivial_sync}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5231371', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20200716.140830'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20200716.140830', 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20200716.140830', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.20771', 'targets': {'smithi157.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgyVhiCUHkw9TAx5ul6bEDUi5feEmqS//plU7UK94mbvrFdi1tdaI6Dxfq+ee4WNSpF11wWxEzO0hD2zPp6mjUKbsrb5HfvA817CwFys8JIXZF1gmWoX1QWq24b07WW2LXccM9pgxy7UsIRy7dD/BLIxxSOfmOVM8coui5+/bDhidOgUfq6AWEHKap9fPXle3Gw+F5bobGdaPeXe72ToB4Jr+6ytGfY0OJG0TV8JhhxNPQu8tW6p+cueGJ2IwOBXTovmpWSsSpowmSpLbeWPXV+keRC8UNNQbDCj0uVxpnHwGD+hxMV6dhYt2zSA2vSDnktjpq6OWMZGCIXvQNP3DPpOGqv3HHjPDktQ1L8HeoeT8F6pXnlfuIj5h/vjKNkSnI1233XxhxUb339G3TE4APQP9ATcPTLBWfPynpl73ZGCbQ3J+BPfUGgnbjd4g3du1lsx0kuTgGd36aNdVk2OR1rgwCfR0OAMkLdu587PIRWaHefVel3BPaBhG9FN5AZtk=', 'smithi041.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKeLp5LDrmfDONyEG2atDEsZrwyOHe1xa1YI35axqfJPMD31zQHyzdnZlTE+4YDryg5Ym9KQCOeZXvZTfzsGPR6ajkJCefs1Z1fXYeZrSiRWbQ7RAYs6CsRiqbc2VZcUnRjSz4b+nFwtEgy+bt/NhBbXZGKohd88u9y3pBVmFk+Db+LvihJN/GOGSq47lZ/0NFd8tnHhaEXAUEEWqXyjaDlHFbSZ+IQAyA5q8bovw8TPlHwkDp+NkWze22TaduGy3nBpsTR6NK20CttvbL/XMZhk5NwNt9B/AZwWTzBa7bacOuf8FpN9i8iw79bH01XT0Qcdtg1ZCun3sb6bDSIozQ0O5bM/D95Y07LGKWNVZWOBCljlbrvCwl/qyUIYIU6tfpvbebIrp5Q55tSRM54G07rF9z9+tm2d/fkT25I1k++EOwdMTe2iAHoNAMemO8/F0yTtDlox/FR8o5bFWqv3sQuYi5pTVWZ/yeAA9xF58pqj/h7kHEH55uom2S4BVYTbM='}} 2020-07-16T20:29:49.698 INFO:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-16T20:29:49.739 INFO:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-16T20:29:49.755 INFO:teuthology.orchestra.run.smithi041:> sudo install -d -m0777 -- /var/run/ceph 2020-07-16T20:29:49.794 INFO:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2020-07-16T20:29:49.884 DEBUG:teuthology.orchestra.remote:smithi157:/scratch_devs is 72B 2020-07-16T20:29:49.910 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T20:29:49.911 INFO:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T20:29:49.926 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T20:29:49.926 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:49.927 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 60595 Links: 1 2020-07-16T20:29:49.927 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:49.927 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:49.928 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2020-07-16 20:29:39.629826520 +0000 2020-07-16T20:29:49.928 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2020-07-16 20:27:44.774719557 +0000 2020-07-16T20:29:49.928 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2020-07-16 20:27:44.774719557 +0000 2020-07-16T20:29:49.929 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2020-07-16T20:29:49.939 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2020-07-16T20:29:49.939 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2020-07-16T20:29:49.940 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000247378 s, 2.1 MB/s 2020-07-16T20:29:49.952 INFO:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T20:29:50.008 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T20:29:50.008 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.008 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 54200 Links: 1 2020-07-16T20:29:50.009 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.009 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.009 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2020-07-16 20:29:39.629826520 +0000 2020-07-16T20:29:50.009 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2020-07-16 20:27:45.165712992 +0000 2020-07-16T20:29:50.009 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2020-07-16 20:27:45.165712992 +0000 2020-07-16T20:29:50.010 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2020-07-16T20:29:50.022 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2020-07-16T20:29:50.023 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2020-07-16T20:29:50.023 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000221679 s, 2.3 MB/s 2020-07-16T20:29:50.025 INFO:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T20:29:50.079 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T20:29:50.080 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.080 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 58701 Links: 1 2020-07-16T20:29:50.080 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.081 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.081 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2020-07-16 20:29:39.629826520 +0000 2020-07-16T20:29:50.081 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2020-07-16 20:27:45.536706764 +0000 2020-07-16T20:29:50.082 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2020-07-16 20:27:45.536706764 +0000 2020-07-16T20:29:50.082 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2020-07-16T20:29:50.093 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2020-07-16T20:29:50.094 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2020-07-16T20:29:50.094 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000209728 s, 2.4 MB/s 2020-07-16T20:29:50.095 INFO:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T20:29:50.149 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T20:29:50.150 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.150 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 63505 Links: 1 2020-07-16T20:29:50.150 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.150 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.150 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2020-07-16 20:29:39.629826520 +0000 2020-07-16T20:29:50.151 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2020-07-16 20:27:45.894700753 +0000 2020-07-16T20:29:50.151 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2020-07-16 20:27:45.894700753 +0000 2020-07-16T20:29:50.151 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2020-07-16T20:29:50.162 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2020-07-16T20:29:50.163 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2020-07-16T20:29:50.163 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000171338 s, 3.0 MB/s 2020-07-16T20:29:50.165 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:50.198 DEBUG:teuthology.orchestra.remote:smithi041:/scratch_devs is 72B 2020-07-16T20:29:50.257 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T20:29:50.258 INFO:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T20:29:50.273 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T20:29:50.274 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.274 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 58614 Links: 1 2020-07-16T20:29:50.274 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.275 INFO:teuthology.orchestra.run.smithi041.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.275 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2020-07-16 20:29:44.918446429 +0000 2020-07-16T20:29:50.275 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2020-07-16 20:27:45.206599957 +0000 2020-07-16T20:29:50.275 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2020-07-16 20:27:45.206599957 +0000 2020-07-16T20:29:50.275 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2020-07-16T20:29:50.295 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2020-07-16T20:29:50.295 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2020-07-16T20:29:50.296 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000216764 s, 2.4 MB/s 2020-07-16T20:29:50.297 INFO:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T20:29:50.350 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T20:29:50.351 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.351 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 61667 Links: 1 2020-07-16T20:29:50.351 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.352 INFO:teuthology.orchestra.run.smithi041.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.352 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2020-07-16 20:29:44.918446429 +0000 2020-07-16T20:29:50.352 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2020-07-16 20:27:45.588595144 +0000 2020-07-16T20:29:50.352 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2020-07-16 20:27:45.588595144 +0000 2020-07-16T20:29:50.352 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2020-07-16T20:29:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2020-07-16T20:29:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2020-07-16T20:29:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000209832 s, 2.4 MB/s 2020-07-16T20:29:50.371 INFO:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T20:29:50.427 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T20:29:50.427 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.428 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 61701 Links: 1 2020-07-16T20:29:50.428 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.428 INFO:teuthology.orchestra.run.smithi041.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.428 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2020-07-16 20:29:44.918446429 +0000 2020-07-16T20:29:50.428 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2020-07-16 20:27:45.952590558 +0000 2020-07-16T20:29:50.429 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2020-07-16 20:27:45.952590558 +0000 2020-07-16T20:29:50.429 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2020-07-16T20:29:50.443 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2020-07-16T20:29:50.444 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2020-07-16T20:29:50.444 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000206868 s, 2.5 MB/s 2020-07-16T20:29:50.446 INFO:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T20:29:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T20:29:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:50.502 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 59813 Links: 1 2020-07-16T20:29:50.502 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:50.503 INFO:teuthology.orchestra.run.smithi041.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:50.503 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2020-07-16 20:29:44.919446414 +0000 2020-07-16T20:29:50.503 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2020-07-16 20:27:46.339585684 +0000 2020-07-16T20:29:50.503 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2020-07-16 20:27:46.339585684 +0000 2020-07-16T20:29:50.503 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2020-07-16T20:29:50.518 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2020-07-16T20:29:50.518 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2020-07-16T20:29:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000166233 s, 3.1 MB/s 2020-07-16T20:29:50.521 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:50.521 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi041.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-07-16T20:29:50.522 INFO:tasks.ceph:Generating config... 2020-07-16T20:29:50.523 INFO:tasks.ceph:[client] client mount timeout = 600 2020-07-16T20:29:50.523 INFO:tasks.ceph:[client] debug client = 20 2020-07-16T20:29:50.524 INFO:tasks.ceph:[client] debug ms = 1 2020-07-16T20:29:50.524 INFO:tasks.ceph:[mds] debug mds = 20 2020-07-16T20:29:50.524 INFO:tasks.ceph:[mds] debug ms = 1 2020-07-16T20:29:50.525 INFO:tasks.ceph:[mds] mds bal frag = True 2020-07-16T20:29:50.525 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-07-16T20:29:50.525 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-07-16T20:29:50.525 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-07-16T20:29:50.526 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-07-16T20:29:50.526 INFO:tasks.ceph:[mds] mds debug frag = True 2020-07-16T20:29:50.526 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-07-16T20:29:50.527 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-07-16T20:29:50.527 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-07-16T20:29:50.527 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-07-16T20:29:50.528 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-07-16T20:29:50.528 INFO:tasks.ceph:[mgr] debug ms = 1 2020-07-16T20:29:50.528 INFO:tasks.ceph:[mon] debug mon = 20 2020-07-16T20:29:50.528 INFO:tasks.ceph:[mon] debug ms = 1 2020-07-16T20:29:50.529 INFO:tasks.ceph:[mon] debug paxos = 20 2020-07-16T20:29:50.529 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-07-16T20:29:50.529 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-07-16T20:29:50.530 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-07-16T20:29:50.530 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-07-16T20:29:50.530 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-07-16T20:29:50.531 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-07-16T20:29:50.531 INFO:tasks.ceph:[osd] debug filestore = 20 2020-07-16T20:29:50.531 INFO:tasks.ceph:[osd] debug journal = 20 2020-07-16T20:29:50.531 INFO:tasks.ceph:[osd] debug ms = 20 2020-07-16T20:29:50.532 INFO:tasks.ceph:[osd] debug osd = 25 2020-07-16T20:29:50.532 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-07-16T20:29:50.532 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:50.532 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-07-16T20:29:50.533 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-07-16T20:29:50.533 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-07-16T20:29:50.533 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-07-16T20:29:50.536 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-07-16T20:29:50.536 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2020-07-16T20:29:50.536 INFO:tasks.ceph:Setting up mon.a... 2020-07-16T20:29:50.537 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-07-16T20:29:50.584 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.keyring 2020-07-16T20:29:50.587 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-07-16T20:29:50.632 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:50.699 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.157'), ('mon.b', '172.21.15.41'), ('mon.c', '[v2:172.21.15.41:3301,v1:172.21.15.41:6790]')] 2020-07-16T20:29:50.700 INFO:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.157 --add b 172.21.15.41 --addv c '[v2:172.21.15.41:3301,v1:172.21.15.41:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:50.784 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:50.785 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: generated fsid cfd2f8dd-09bb-4e6b-8709-0ded1adfce51 2020-07-16T20:29:50.785 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 0 2020-07-16T20:29:50.785 INFO:teuthology.orchestra.run.smithi157.stdout:fsid cfd2f8dd-09bb-4e6b-8709-0ded1adfce51 2020-07-16T20:29:50.785 INFO:teuthology.orchestra.run.smithi157.stdout:last_changed 2020-07-16T20:29:50.779414+0000 2020-07-16T20:29:50.786 INFO:teuthology.orchestra.run.smithi157.stdout:created 2020-07-16T20:29:50.779414+0000 2020-07-16T20:29:50.786 INFO:teuthology.orchestra.run.smithi157.stdout:min_mon_release 0 (unknown) 2020-07-16T20:29:50.786 INFO:teuthology.orchestra.run.smithi157.stdout:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2020-07-16T20:29:50.786 INFO:teuthology.orchestra.run.smithi157.stdout:1: [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] mon.b 2020-07-16T20:29:50.786 INFO:teuthology.orchestra.run.smithi157.stdout:2: [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] mon.c 2020-07-16T20:29:50.787 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-07-16T20:29:50.787 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cfd2f8dd-09bb-4e6b-8709-0ded1adfce51... 2020-07-16T20:29:50.788 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-16T20:29:50.801 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-16T20:29:50.862 INFO:teuthology.orchestra.run.smithi041.stdout:[global] 2020-07-16T20:29:50.863 INFO:teuthology.orchestra.run.smithi041.stdout: chdir = "" 2020-07-16T20:29:50.863 INFO:teuthology.orchestra.run.smithi041.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-16T20:29:50.863 INFO:teuthology.orchestra.run.smithi041.stdout: auth supported = cephx 2020-07-16T20:29:50.863 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: filestore xattr use omap = true 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: mon clock drift allowed = 1.000 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: osd crush chooseleaf type = 0 2020-07-16T20:29:50.864 INFO:teuthology.orchestra.run.smithi041.stdout: auth debug = true 2020-07-16T20:29:50.865 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.865 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on old message = true 2020-07-16T20:29:50.865 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on bug = true 2020-07-16T20:29:50.865 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.865 INFO:teuthology.orchestra.run.smithi041.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-16T20:29:50.866 INFO:teuthology.orchestra.run.smithi041.stdout: mon pg warn max object skew = 0 2020-07-16T20:29:50.866 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.866 INFO:teuthology.orchestra.run.smithi041.stdout: # disable pg_autoscaler by default for new pools 2020-07-16T20:29:50.866 INFO:teuthology.orchestra.run.smithi041.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-16T20:29:50.866 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.867 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default size = 2 2020-07-16T20:29:50.867 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.867 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow primary affinity = true 2020-07-16T20:29:50.867 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow pg remap = true 2020-07-16T20:29:50.867 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on legacy crush tunables = false 2020-07-16T20:29:50.871 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on crush straw calc version zero = false 2020-07-16T20:29:50.871 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on no sortbitwise = false 2020-07-16T20:29:50.872 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on osd down out interval zero = false 2020-07-16T20:29:50.872 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on too few osds = false 2020-07-16T20:29:50.872 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-16T20:29:50.872 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-16T20:29:50.873 INFO:teuthology.orchestra.run.smithi041.stdout: mon_allow_pool_size_one = true 2020-07-16T20:29:50.873 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-16T20:29:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: osd default data pool replay window = 5 2020-07-16T20:29:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: mon allow pool delete = true 2020-07-16T20:29:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: mon cluster log file level = debug 2020-07-16T20:29:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: debug asserts on shutdown = true 2020-07-16T20:29:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: mon host = "172.21.15.157,172.21.15.41,[v2:172.21.15.41:3301,v1:172.21.15.41:6790]" 2020-07-16T20:29:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: fsid = cfd2f8dd-09bb-4e6b-8709-0ded1adfce51 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout:[osd] 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: osd journal size = 100 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub load threshold = 5.0 2020-07-16T20:29:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub max interval = 600 2020-07-16T20:29:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: osd recover clone overlap = true 2020-07-16T20:29:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: osd recovery max chunk = 1048576 2020-07-16T20:29:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug shutdown = true 2020-07-16T20:29:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug op order = true 2020-07-16T20:29:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug verify stray on activate = true 2020-07-16T20:29:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: osd open classes on start = true 2020-07-16T20:29:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug pg log writeout = true 2020-07-16T20:29:50.880 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.881 INFO:teuthology.orchestra.run.smithi041.stdout: osd deep scrub update digest min age = 30 2020-07-16T20:29:50.881 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.881 INFO:teuthology.orchestra.run.smithi041.stdout: osd map max advance = 10 2020-07-16T20:29:50.881 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.882 INFO:teuthology.orchestra.run.smithi041.stdout: journal zero on create = true 2020-07-16T20:29:50.882 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.882 INFO:teuthology.orchestra.run.smithi041.stdout: filestore ondisk finisher threads = 3 2020-07-16T20:29:50.882 INFO:teuthology.orchestra.run.smithi041.stdout: filestore apply finisher threads = 3 2020-07-16T20:29:50.882 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.883 INFO:teuthology.orchestra.run.smithi041.stdout: bdev debug aio = true 2020-07-16T20:29:50.883 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug misdirected ops = true 2020-07-16T20:29:50.883 INFO:teuthology.orchestra.run.smithi041.stdout: bluestore block size = 96636764160 2020-07-16T20:29:50.883 INFO:teuthology.orchestra.run.smithi041.stdout: bluestore compression mode = aggressive 2020-07-16T20:29:50.883 INFO:teuthology.orchestra.run.smithi041.stdout: bluestore fsck on mount = True 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug bluefs = 20 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug bluestore = 20 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug filestore = 20 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug journal = 20 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 20 2020-07-16T20:29:50.884 INFO:teuthology.orchestra.run.smithi041.stdout: debug osd = 25 2020-07-16T20:29:50.885 INFO:teuthology.orchestra.run.smithi041.stdout: debug rocksdb = 10 2020-07-16T20:29:50.885 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:50.885 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd full ratio = 0.9 2020-07-16T20:29:50.885 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd nearfull ratio = 0.8 2020-07-16T20:29:50.885 INFO:teuthology.orchestra.run.smithi041.stdout: osd failsafe full ratio = 0.95 2020-07-16T20:29:50.886 INFO:teuthology.orchestra.run.smithi041.stdout: osd objectstore = bluestore 2020-07-16T20:29:50.886 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2020-07-16T20:29:50.886 INFO:teuthology.orchestra.run.smithi041.stdout: osd_max_omap_entries_per_request = 10 2020-07-16T20:29:50.886 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.886 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr] 2020-07-16T20:29:50.887 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2020-07-16T20:29:50.887 INFO:teuthology.orchestra.run.smithi041.stdout: debug mgr = 20 2020-07-16T20:29:50.887 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2020-07-16T20:29:50.887 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2020-07-16T20:29:50.887 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout: mgr/telemetry/nag = false 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout:[mon] 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2020-07-16T20:29:50.888 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2020-07-16T20:29:50.889 INFO:teuthology.orchestra.run.smithi041.stdout: debug paxos = 20 2020-07-16T20:29:50.889 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2020-07-16T20:29:50.889 INFO:teuthology.orchestra.run.smithi041.stdout: mon data avail warn = 5 2020-07-16T20:29:50.889 INFO:teuthology.orchestra.run.smithi041.stdout: mon mgr mkfs grace = 240 2020-07-16T20:29:50.889 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:50.890 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd reporter subtree level = osd 2020-07-16T20:29:50.890 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd prime pg temp = true 2020-07-16T20:29:50.890 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:50.890 INFO:teuthology.orchestra.run.smithi041.stdout: mon op complaint time = 120 2020-07-16T20:29:50.890 INFO:teuthology.orchestra.run.smithi041.stdout: 2020-07-16T20:29:50.891 INFO:teuthology.orchestra.run.smithi041.stdout:[client] 2020-07-16T20:29:50.891 INFO:teuthology.orchestra.run.smithi041.stdout: rgw cache enabled = true 2020-07-16T20:29:50.891 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable ops log = true 2020-07-16T20:29:50.891 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable usage log = true 2020-07-16T20:29:50.891 INFO:teuthology.orchestra.run.smithi041.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout: client mount timeout = 600 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout: debug client = 20 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.a] 2020-07-16T20:29:50.892 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.b] 2020-07-16T20:29:50.893 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.c] 2020-07-16T20:29:50.893 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2020-07-16T20:29:50.893 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2020-07-16T20:29:50.893 INFO:teuthology.orchestra.run.smithi041.stdout:[mds] 2020-07-16T20:29:50.893 INFO:teuthology.orchestra.run.smithi041.stdout: debug mds = 20 2020-07-16T20:29:50.894 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2020-07-16T20:29:50.894 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal frag = True 2020-07-16T20:29:50.894 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal fragment size max = 10000 2020-07-16T20:29:50.894 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal merge size = 5 2020-07-16T20:29:50.894 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split bits = 3 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split size = 100 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug frag = True 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug scatterstat = True 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: mds op complaint time = 180 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: mds verify scatter = True 2020-07-16T20:29:50.895 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2020-07-16T20:29:50.897 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2020-07-16T20:29:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2020-07-16T20:29:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-16T20:29:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2020-07-16T20:29:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2020-07-16T20:29:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2020-07-16T20:29:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2020-07-16T20:29:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2020-07-16T20:29:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2020-07-16T20:29:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2020-07-16T20:29:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-16T20:29:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2020-07-16T20:29:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2020-07-16T20:29:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-16T20:29:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2020-07-16T20:29:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2020-07-16T20:29:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2020-07-16T20:29:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-16T20:29:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-16T20:29:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2020-07-16T20:29:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-16T20:29:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2020-07-16T20:29:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2020-07-16T20:29:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2020-07-16T20:29:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2020-07-16T20:29:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.157,172.21.15.41,[v2:172.21.15.41:3301,v1:172.21.15.41:6790]" 2020-07-16T20:29:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = cfd2f8dd-09bb-4e6b-8709-0ded1adfce51 2020-07-16T20:29:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.914 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2020-07-16T20:29:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2020-07-16T20:29:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2020-07-16T20:29:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2020-07-16T20:29:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2020-07-16T20:29:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2020-07-16T20:29:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2020-07-16T20:29:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2020-07-16T20:29:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2020-07-16T20:29:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2020-07-16T20:29:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2020-07-16T20:29:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2020-07-16T20:29:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2020-07-16T20:29:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2020-07-16T20:29:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2020-07-16T20:29:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression mode = aggressive 2020-07-16T20:29:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2020-07-16T20:29:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2020-07-16T20:29:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2020-07-16T20:29:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: debug filestore = 20 2020-07-16T20:29:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: debug journal = 20 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 20 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 25 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2020-07-16T20:29:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2020-07-16T20:29:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2020-07-16T20:29:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2020-07-16T20:29:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2020-07-16T20:29:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: osd_max_omap_entries_per_request = 10 2020-07-16T20:29:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.923 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2020-07-16T20:29:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2020-07-16T20:29:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2020-07-16T20:29:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2020-07-16T20:29:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2020-07-16T20:29:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2020-07-16T20:29:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.924 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2020-07-16T20:29:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2020-07-16T20:29:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2020-07-16T20:29:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2020-07-16T20:29:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2020-07-16T20:29:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:29:50.927 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2020-07-16T20:29:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2020-07-16T20:29:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2020-07-16T20:29:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2020-07-16T20:29:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-16T20:29:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-16T20:29:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2020-07-16T20:29:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2020-07-16T20:29:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2020-07-16T20:29:50.929 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2020-07-16T20:29:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2020-07-16T20:29:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2020-07-16T20:29:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal frag = True 2020-07-16T20:29:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal fragment size max = 10000 2020-07-16T20:29:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal merge size = 5 2020-07-16T20:29:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split bits = 3 2020-07-16T20:29:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split size = 100 2020-07-16T20:29:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2020-07-16T20:29:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2020-07-16T20:29:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2020-07-16T20:29:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2020-07-16T20:29:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2020-07-16T20:29:50.932 INFO:tasks.ceph:Creating admin key on mon.a... 2020-07-16T20:29:50.933 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-07-16T20:29:50.986 INFO:tasks.ceph:Copying monmap to all nodes... 2020-07-16T20:29:51.006 DEBUG:teuthology.orchestra.remote:smithi157:/etc/ceph/ceph.keyring is 206B 2020-07-16T20:29:51.052 DEBUG:teuthology.orchestra.remote:smithi157:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-07-16T20:29:51.114 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:29:51.115 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:51.181 INFO:teuthology.orchestra.run.smithi157:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:51.266 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:29:51.267 INFO:teuthology.orchestra.run.smithi041:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:51.336 INFO:teuthology.orchestra.run.smithi041:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:51.425 INFO:tasks.ceph:Setting up mon nodes... 2020-07-16T20:29:51.427 INFO:tasks.ceph:Setting up mgr nodes... 2020-07-16T20:29:51.428 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-07-16T20:29:51.491 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-07-16T20:29:51.491 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-07-16T20:29:51.566 INFO:teuthology.orchestra.run.smithi041.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-07-16T20:29:51.570 INFO:tasks.ceph:Setting up mds nodes... 2020-07-16T20:29:51.571 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-07-16T20:29:51.625 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-07-16T20:29:51.627 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-07-16T20:29:51.655 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-07-16T20:29:51.719 INFO:teuthology.orchestra.run.smithi041.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-07-16T20:29:51.721 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-07-16T20:29:51.761 INFO:tasks.ceph_client:Setting up client nodes... 2020-07-16T20:29:51.762 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-07-16T20:29:51.802 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-07-16T20:29:51.818 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-07-16T20:29:51.818 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi041.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-07-16T20:29:51.819 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:51.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:51.886 INFO:tasks.ceph:role: osd.0 2020-07-16T20:29:51.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:29:51.887 INFO:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-07-16T20:29:52.438 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:52.438 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:52.438 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:52.439 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2020-07-16T20:29:52.439 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:52.439 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:52.439 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:52.439 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:52.440 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:52.440 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:52.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2020-07-16T20:29:52.441 INFO:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:52.567 INFO:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:52.603 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:52.676 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:52.676 INFO:tasks.ceph:role: osd.1 2020-07-16T20:29:52.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:29:52.677 INFO:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-07-16T20:29:53.577 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:53.577 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:53.577 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:53.578 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2020-07-16T20:29:53.578 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:53.578 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:53.578 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:53.578 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:53.579 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:53.579 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:53.580 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2020-07-16T20:29:53.580 INFO:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:53.656 INFO:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:53.691 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:53.765 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:53.765 INFO:tasks.ceph:role: osd.2 2020-07-16T20:29:53.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:29:53.777 INFO:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-07-16T20:29:54.307 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2020-07-16T20:29:54.308 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:54.309 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:54.309 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:54.310 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:54.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2020-07-16T20:29:54.311 INFO:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:54.420 INFO:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:54.462 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:54.531 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:54.531 INFO:tasks.ceph:role: osd.3 2020-07-16T20:29:54.532 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2020-07-16T20:29:54.532 INFO:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-07-16T20:29:55.063 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:55.063 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:55.064 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:55.064 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2020-07-16T20:29:55.064 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:55.065 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:55.065 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:55.066 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:55.066 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:55.067 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:55.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2020-07-16T20:29:55.068 INFO:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:55.167 INFO:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:55.209 INFO:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:55.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.303+0000 7f0eeb9e9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-07-16T20:29:55.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.304+0000 7f0eeb9e9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-07-16T20:29:55.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.304+0000 7f0eeb9e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:55.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.304+0000 7f0eeb9e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:55.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.304+0000 7f0eeb9e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:55.307 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:55.304+0000 7f0eeb9e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-07-16T20:29:57.656 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:57.729 INFO:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:57.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-07-16T20:29:57.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-07-16T20:29:57.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:57.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:57.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:57.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:29:57.816+0000 7f4393608ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-07-16T20:30:00.166 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-07-16T20:30:00.200 INFO:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-07-16T20:30:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-07-16T20:30:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:30:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:30:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:30:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:00.287+0000 7f41ecae6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-07-16T20:30:02.631 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-07-16T20:30:02.664 INFO:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:02.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.753+0000 7f7e1f527ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-07-16T20:30:02.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.753+0000 7f7e1f527ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-07-16T20:30:02.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.753+0000 7f7e1f527ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:30:02.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.753+0000 7f7e1f527ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:30:02.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.753+0000 7f7e1f527ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:30:02.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:02.754+0000 7f7e1f527ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-07-16T20:30:05.106 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-07-16T20:30:05.140 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-07-16T20:30:05.181 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:30:05.182 INFO:tasks.ceph:role: osd.4 2020-07-16T20:30:05.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:30:05.183 INFO:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-07-16T20:30:05.741 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:30:05.774 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:30:05.775 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:30:05.775 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2020-07-16T20:30:05.775 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:30:05.776 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:30:05.776 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:30:05.776 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:30:05.776 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:30:05.777 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:30:05.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2020-07-16T20:30:05.778 INFO:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-07-16T20:30:05.905 INFO:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-07-16T20:30:05.954 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-07-16T20:30:06.037 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:30:06.038 INFO:tasks.ceph:role: osd.5 2020-07-16T20:30:06.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:30:06.039 INFO:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-07-16T20:30:06.551 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:30:06.551 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:30:06.552 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:30:06.552 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2020-07-16T20:30:06.552 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:30:06.553 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:30:06.553 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:30:06.553 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:30:06.554 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:30:06.554 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:30:06.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2020-07-16T20:30:06.555 INFO:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-07-16T20:30:06.651 INFO:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-07-16T20:30:06.690 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-07-16T20:30:06.762 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:30:06.763 INFO:tasks.ceph:role: osd.6 2020-07-16T20:30:06.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:30:06.764 INFO:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-07-16T20:30:07.308 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:30:07.308 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:30:07.308 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:30:07.309 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2020-07-16T20:30:07.309 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:30:07.309 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:30:07.310 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:30:07.310 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:30:07.310 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:30:07.311 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:30:07.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2020-07-16T20:30:07.312 INFO:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-07-16T20:30:07.429 INFO:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-07-16T20:30:07.486 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-07-16T20:30:07.568 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:30:07.569 INFO:tasks.ceph:role: osd.7 2020-07-16T20:30:07.570 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi041.front.sepia.ceph.com 2020-07-16T20:30:07.570 INFO:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-07-16T20:30:08.121 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:30:08.121 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:30:08.121 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:30:08.122 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2020-07-16T20:30:08.122 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:30:08.122 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:30:08.122 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:30:08.122 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:30:08.123 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:30:08.123 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:30:08.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2020-07-16T20:30:08.123 INFO:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-07-16T20:30:08.261 INFO:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-07-16T20:30:08.303 INFO:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:08.398 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.394+0000 7fb6c6dfcec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-07-16T20:30:08.399 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.394+0000 7fb6c6dfcec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-07-16T20:30:08.399 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.394+0000 7fb6c6dfcec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:30:08.401 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.394+0000 7fb6c6dfcec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:30:08.402 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.394+0000 7fb6c6dfcec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:30:08.402 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:08.395+0000 7fb6c6dfcec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-07-16T20:30:10.751 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T20:30:10.788 INFO:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:10.886 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.882+0000 7f99afef9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-07-16T20:30:10.886 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.882+0000 7f99afef9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-07-16T20:30:10.887 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.882+0000 7f99afef9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:30:10.888 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.882+0000 7f99afef9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:30:10.888 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.882+0000 7f99afef9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:30:10.889 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:10.883+0000 7f99afef9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-07-16T20:30:13.227 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-07-16T20:30:13.266 INFO:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:13.362 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.361+0000 7fd4818f8ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-07-16T20:30:13.363 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.361+0000 7fd4818f8ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-07-16T20:30:13.363 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.361+0000 7fd4818f8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:30:13.363 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.361+0000 7fd4818f8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:30:13.364 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.361+0000 7fd4818f8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:30:13.364 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:13.362+0000 7fd4818f8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-07-16T20:30:15.708 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-07-16T20:30:15.755 INFO:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:15.865 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.855+0000 7febabea6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-07-16T20:30:15.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.856+0000 7febabea6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-07-16T20:30:15.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.856+0000 7febabea6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:30:15.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.856+0000 7febabea6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:30:15.868 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.856+0000 7febabea6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:30:15.868 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:15.856+0000 7febabea6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-07-16T20:30:18.209 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-07-16T20:30:18.247 INFO:tasks.ceph:Reading keys from all nodes... 2020-07-16T20:30:18.248 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:18.269 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.BPnyEs1ZUZ 2020-07-16T20:30:18.270 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.BPnyEs1ZUZ 2020-07-16T20:30:18.341 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.BPnyEs1ZUZ 2020-07-16T20:30:18.474 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.BPnyEs1ZUZ is 56B 2020-07-16T20:30:18.528 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.BPnyEs1ZUZ 2020-07-16T20:30:18.544 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:18.598 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.32RtaZsqMD 2020-07-16T20:30:18.599 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.32RtaZsqMD 2020-07-16T20:30:18.666 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.32RtaZsqMD 2020-07-16T20:30:18.793 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.32RtaZsqMD is 56B 2020-07-16T20:30:18.869 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.32RtaZsqMD 2020-07-16T20:30:18.887 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:18.948 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.vsNTENIUNW 2020-07-16T20:30:18.949 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.vsNTENIUNW 2020-07-16T20:30:19.019 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.vsNTENIUNW 2020-07-16T20:30:19.158 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.vsNTENIUNW is 56B 2020-07-16T20:30:19.213 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.vsNTENIUNW 2020-07-16T20:30:19.231 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:19.285 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.8LdNBg2JHm 2020-07-16T20:30:19.285 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.8LdNBg2JHm 2020-07-16T20:30:19.352 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.8LdNBg2JHm 2020-07-16T20:30:19.481 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.8LdNBg2JHm is 56B 2020-07-16T20:30:19.558 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.8LdNBg2JHm 2020-07-16T20:30:19.574 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:19.627 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.0trMlzVvvH 2020-07-16T20:30:19.628 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.0trMlzVvvH 2020-07-16T20:30:19.695 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.0trMlzVvvH 2020-07-16T20:30:19.703 INFO:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:19.706 INFO:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:19.830 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.0trMlzVvvH is 56B 2020-07-16T20:30:19.910 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.0trMlzVvvH 2020-07-16T20:30:19.927 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:19.999 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.uvl7Q4h3f7 2020-07-16T20:30:20.000 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.uvl7Q4h3f7 2020-07-16T20:30:20.071 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.uvl7Q4h3f7 2020-07-16T20:30:20.211 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.uvl7Q4h3f7 is 56B 2020-07-16T20:30:20.279 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.uvl7Q4h3f7 2020-07-16T20:30:20.297 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:20.318 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.AolgkJjc9K 2020-07-16T20:30:20.319 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.AolgkJjc9K 2020-07-16T20:30:20.399 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.AolgkJjc9K 2020-07-16T20:30:20.556 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.AolgkJjc9K is 56B 2020-07-16T20:30:20.612 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.AolgkJjc9K 2020-07-16T20:30:20.630 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:20.687 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.pjvH4oRhV4 2020-07-16T20:30:20.687 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.pjvH4oRhV4 2020-07-16T20:30:20.764 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.pjvH4oRhV4 2020-07-16T20:30:20.906 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.pjvH4oRhV4 is 56B 2020-07-16T20:30:20.958 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.pjvH4oRhV4 2020-07-16T20:30:20.977 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:21.036 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.eX2crfc8ba 2020-07-16T20:30:21.037 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.eX2crfc8ba 2020-07-16T20:30:21.117 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.eX2crfc8ba 2020-07-16T20:30:21.254 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.eX2crfc8ba is 56B 2020-07-16T20:30:21.322 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.eX2crfc8ba 2020-07-16T20:30:21.341 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:21.399 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.EnKqjJIyKY 2020-07-16T20:30:21.400 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.EnKqjJIyKY 2020-07-16T20:30:21.477 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.EnKqjJIyKY 2020-07-16T20:30:21.615 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.EnKqjJIyKY is 56B 2020-07-16T20:30:21.670 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.EnKqjJIyKY 2020-07-16T20:30:21.687 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:21.746 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.wUbVUENFH9 2020-07-16T20:30:21.747 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.wUbVUENFH9 2020-07-16T20:30:21.847 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.wUbVUENFH9 2020-07-16T20:30:21.943 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.wUbVUENFH9 is 56B 2020-07-16T20:30:21.966 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.wUbVUENFH9 2020-07-16T20:30:21.983 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:22.041 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.tJS24xiZte 2020-07-16T20:30:22.041 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.tJS24xiZte 2020-07-16T20:30:22.114 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.tJS24xiZte 2020-07-16T20:30:22.253 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.tJS24xiZte is 56B 2020-07-16T20:30:22.313 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.tJS24xiZte 2020-07-16T20:30:22.350 DEBUG:teuthology.orchestra.remote:smithi157:/etc/ceph/ceph.client.0.keyring is 59B 2020-07-16T20:30:22.408 INFO:tasks.ceph:Adding keys to all mons... 2020-07-16T20:30:22.409 INFO:teuthology.orchestra.run.smithi041:> sudo tee -a /etc/ceph/ceph.keyring 2020-07-16T20:30:22.412 INFO:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2020-07-16T20:30:22.440 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr.y] 2020-07-16T20:30:22.440 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQC/uBBfUzzUHBAA7HwXOBp4Rhdvm/tQdiwnww== 2020-07-16T20:30:22.441 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2020-07-16T20:30:22.441 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQC/uBBfs51LJRAAOKexBI2Z1KQdblIfbUDxxw== 2020-07-16T20:30:22.441 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.0] 2020-07-16T20:30:22.442 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDDuBBfydYuEhAAwFv1uyNYvbGSO0ab3vnALQ== 2020-07-16T20:30:22.442 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.1] 2020-07-16T20:30:22.442 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDFuBBfsNy4MBAAl8Ph5lXBwNdIVpaYuw74+Q== 2020-07-16T20:30:22.442 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.2] 2020-07-16T20:30:22.442 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDIuBBfLxQxERAA6lI7a6mZjzUHU3ocvz3gHw== 2020-07-16T20:30:22.443 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.3] 2020-07-16T20:30:22.443 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDKuBBfRbL4LBAA4aVtdClyYOS6D3T6kXPK4g== 2020-07-16T20:30:22.443 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr.x] 2020-07-16T20:30:22.443 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQC/uBBfQ2q8IRAAXweKLvs9Hn/d3h9iL0eHbQ== 2020-07-16T20:30:22.443 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQC/uBBfGdvfKhAA8b83ale1F8dMZqR5yEsSqQ== 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.4] 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDQuBBf7hSGFxAAfWCoWhpTvYW0G5J6ZmJ6Lg== 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.5] 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDSuBBfv4GbNBAAkOFZNoLzrJwBLVDncgJO8w== 2020-07-16T20:30:22.444 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.6] 2020-07-16T20:30:22.445 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDVuBBfR8KPFRAAMYTfbCv8kupuFkOj6O7PqA== 2020-07-16T20:30:22.445 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.7] 2020-07-16T20:30:22.445 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQDXuBBfisoYMxAA9ev0sfUgbl/4Nrh4pj35MQ== 2020-07-16T20:30:22.445 INFO:teuthology.orchestra.run.smithi041.stdout:[client.0] 2020-07-16T20:30:22.445 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQC/uBBfGW3MLxAAj7oluZwP63RwEmsN0OXD3A== 2020-07-16T20:30:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2020-07-16T20:30:22.457 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC/uBBfUzzUHBAA7HwXOBp4Rhdvm/tQdiwnww== 2020-07-16T20:30:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2020-07-16T20:30:22.457 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC/uBBfs51LJRAAOKexBI2Z1KQdblIfbUDxxw== 2020-07-16T20:30:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2020-07-16T20:30:22.458 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDDuBBfydYuEhAAwFv1uyNYvbGSO0ab3vnALQ== 2020-07-16T20:30:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2020-07-16T20:30:22.459 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDFuBBfsNy4MBAAl8Ph5lXBwNdIVpaYuw74+Q== 2020-07-16T20:30:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2020-07-16T20:30:22.459 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDIuBBfLxQxERAA6lI7a6mZjzUHU3ocvz3gHw== 2020-07-16T20:30:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2020-07-16T20:30:22.460 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDKuBBfRbL4LBAA4aVtdClyYOS6D3T6kXPK4g== 2020-07-16T20:30:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2020-07-16T20:30:22.460 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC/uBBfQ2q8IRAAXweKLvs9Hn/d3h9iL0eHbQ== 2020-07-16T20:30:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2020-07-16T20:30:22.461 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC/uBBfGdvfKhAA8b83ale1F8dMZqR5yEsSqQ== 2020-07-16T20:30:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2020-07-16T20:30:22.462 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDQuBBf7hSGFxAAfWCoWhpTvYW0G5J6ZmJ6Lg== 2020-07-16T20:30:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2020-07-16T20:30:22.462 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDSuBBfv4GbNBAAkOFZNoLzrJwBLVDncgJO8w== 2020-07-16T20:30:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2020-07-16T20:30:22.463 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDVuBBfR8KPFRAAMYTfbCv8kupuFkOj6O7PqA== 2020-07-16T20:30:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2020-07-16T20:30:22.464 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDXuBBfisoYMxAA9ev0sfUgbl/4Nrh4pj35MQ== 2020-07-16T20:30:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2020-07-16T20:30:22.465 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC/uBBfGW3MLxAAj7oluZwP63RwEmsN0OXD3A== 2020-07-16T20:30:22.466 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:22.491 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:22.558 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:22.567 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:22.621 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.625 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.683 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.715 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.765 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.794 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.844 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.850 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:22.899 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:22.908 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:22.958 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:22.961 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:23.014 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.024 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.079 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.082 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.133 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.143 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.193 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.200 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:23.281 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:23.286 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:23.338 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-07-16T20:30:23.339 INFO:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-07-16T20:30:23.368 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:23.462 INFO:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-07-16T20:30:23.503 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-07-16T20:30:23.538 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:23.643 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-07-16T20:30:23.686 INFO:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-07-16T20:30:23.758 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:23.865 INFO:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-07-16T20:30:23.899 INFO:teuthology.orchestra.run.smithi041:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:23.942 INFO:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:23.971 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-07-16T20:30:23.972 INFO:tasks.ceph.mon.a:Restarting daemon 2020-07-16T20:30:23.973 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-07-16T20:30:24.014 INFO:tasks.ceph.mon.a:Started 2020-07-16T20:30:24.014 INFO:tasks.ceph.mon.b:Restarting daemon 2020-07-16T20:30:24.015 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-07-16T20:30:24.044 INFO:tasks.ceph.mon.b:Started 2020-07-16T20:30:24.045 INFO:tasks.ceph.mon.c:Restarting daemon 2020-07-16T20:30:24.046 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-07-16T20:30:24.050 INFO:tasks.ceph.mon.c:Started 2020-07-16T20:30:24.057 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-07-16T20:30:24.058 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-07-16T20:30:24.058 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-07-16T20:30:24.069 INFO:tasks.ceph.mgr.y:Started 2020-07-16T20:30:24.070 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-07-16T20:30:24.070 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-07-16T20:30:24.076 INFO:tasks.ceph.mgr.x:Started 2020-07-16T20:30:24.077 INFO:tasks.ceph:Setting crush tunables to default 2020-07-16T20:30:24.078 INFO:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd crush tunables default 2020-07-16T20:30:29.380 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.187+0000 7fad8accd700 1 Processor -- start 2020-07-16T20:30:29.381 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.187+0000 7fad8accd700 1 -- start start 2020-07-16T20:30:29.381 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad8accd700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.381 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad8accd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840a2d80 con 0x7fad840a5810 2020-07-16T20:30:29.382 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad8accd700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840a3660 con 0x7fad8414e3f0 2020-07-16T20:30:29.382 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad8accd700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840680a0 con 0x7fad84067c20 2020-07-16T20:30:29.382 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad89a6b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fad8414e3f0 0x7fad841507e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:35734/0 (socket says 172.21.15.157:35734) 2020-07-16T20:30:29.383 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 learned_addr learned my addr 172.21.15.157:0/2944340484 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:29.383 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.383 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.384 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.384 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.384 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.188+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-07-16T20:30:29.385 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.389+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.385 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.389+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.389+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.389+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.389+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-07-16T20:30:29.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.790+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.790+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.790+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.790+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:24.790+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-07-16T20:30:29.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 msgr2=0x7fad840807a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-07-16T20:30:29.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad84067c20 0x7fad840807a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 >> v1:172.21.15.157:6789/0 conn(0x7fad8414e3f0 legacy=0x7fad841507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 >> v1:172.21.15.41:6789/0 conn(0x7fad840a5810 legacy=0x7fad840a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840680a0 con 0x7fad68005eb0 2020-07-16T20:30:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6804ca50 con 0x7fad68003430 2020-07-16T20:30:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.394 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.394 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.188+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-07-16T20:30:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.189+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.397 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.189+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-07-16T20:30:29.397 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.189+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.398 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.189+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.398 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.189+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-07-16T20:30:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.389+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.389+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.389+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.389+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.389+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-07-16T20:30:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.390+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.390+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.390+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.390+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.390+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-07-16T20:30:29.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.790+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.790+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.790+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.790+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.790+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-07-16T20:30:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.791+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.791+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.791+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.791+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:25.791+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-07-16T20:30:29.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.591+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.591+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.591+0000 7fad8926a700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.591+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.591+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-07-16T20:30:29.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.592+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.592+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-07-16T20:30:29.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.592+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.592+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:26.593+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-07-16T20:30:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 msgr2=0x7fad680058b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-07-16T20:30:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.157:3300/0 conn(0x7fad68003430 0x7fad680058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 msgr2=0x7fad68008350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-07-16T20:30:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad68005eb0 0x7fad68008350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 reap_dead start 2020-07-16T20:30:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840a38c0 con 0x7fad68003880 2020-07-16T20:30:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad68008520 con 0x7fad8414e3f0 2020-07-16T20:30:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad7affd700 1 -- 172.21.15.157:0/2944340484 --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840680a0 con 0x7fad680079b0 2020-07-16T20:30:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.189+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.390+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.390+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.390+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.390+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.390+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-07-16T20:30:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.791+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.791+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.791+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.791+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:28.791+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-07-16T20:30:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.367+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277022748 0 0) 0x7fad840a38c0 con 0x7fad68003880 2020-07-16T20:30:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.367+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad70003240 con 0x7fad68003880 2020-07-16T20:30:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164965437 0 0) 0x7fad68008520 con 0x7fad8414e3f0 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad840a38c0 con 0x7fad8414e3f0 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 956962445 0 0) 0x7fad840a38c0 con 0x7fad8414e3f0 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 msgr2=0x7fad68007e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 --2- 172.21.15.157:0/2944340484 >> v2:172.21.15.41:3300/0 conn(0x7fad680079b0 0x7fad68007e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 >> v1:172.21.15.41:6789/0 conn(0x7fad68003880 legacy=0x7fad68006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68054580 con 0x7fad8414e3f0 2020-07-16T20:30:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fad80001590 con 0x7fad8414e3f0 2020-07-16T20:30:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 >> v1:172.21.15.157:6789/0 conn(0x7fad8414e3f0 legacy=0x7fad6804ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad700038c0 0x7fad70003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 0x7fad70004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad70004e50 0x7fad7000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840680a0 con 0x7fad70004e50 2020-07-16T20:30:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000bc20 con 0x7fad700044e0 2020-07-16T20:30:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.368+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000bd60 con 0x7fad700038c0 2020-07-16T20:30:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 0x7fad70004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad8926a700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad700038c0 0x7fad70003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad89a6b700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad70004e50 0x7fad7000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad700038c0 msgr2=0x7fad70003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fad700038c0 0x7fad70003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad70004e50 msgr2=0x7fad7000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad70004e50 0x7fad7000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 -- 172.21.15.157:0/2944340484 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840a38c0 con 0x7fad700044e0 2020-07-16T20:30:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad89a6b700 1 -- 172.21.15.157:0/2944340484 reap_dead start 2020-07-16T20:30:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad88a69700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 0x7fad70004960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fad74007000 tx=0x7fad74008040).ready entity=mon.1 client_cookie=baf3c920ca66d37f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad74019c10 con 0x7fad700044e0 2020-07-16T20:30:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74019d70 con 0x7fad700044e0 2020-07-16T20:30:29.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad7bfff700 1 -- 172.21.15.157:0/2944340484 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad74022630 con 0x7fad700044e0 2020-07-16T20:30:29.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad8accd700 1 -- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 msgr2=0x7fad70004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.369+0000 7fad8accd700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 0x7fad70004960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fad74007000 tx=0x7fad74008040).stop 2020-07-16T20:30:29.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.370+0000 7fad8accd700 1 -- 172.21.15.157:0/2944340484 shutdown_connections 2020-07-16T20:30:29.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.370+0000 7fad8accd700 1 --2- 172.21.15.157:0/2944340484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad700044e0 0x7fad70004960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.370+0000 7fad8accd700 1 -- 172.21.15.157:0/2944340484 >> 172.21.15.157:0/2944340484 conn(0x7fad8405b810 msgr2=0x7fad8405bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:29.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.370+0000 7fad8accd700 1 -- 172.21.15.157:0/2944340484 shutdown_connections 2020-07-16T20:30:29.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.370+0000 7fad8accd700 1 -- 172.21.15.157:0/2944340484 wait complete. 2020-07-16T20:30:29.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.372+0000 7fad8accd700 1 Processor -- start 2020-07-16T20:30:29.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad8accd700 1 -- start start 2020-07-16T20:30:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad8accd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fad8407fdb0 0x7fad84140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad8accd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840677e0 con 0x7fad84064790 2020-07-16T20:30:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad8accd700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84065480 con 0x7fad84065bc0 2020-07-16T20:30:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad8accd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad84065720 con 0x7fad8407fdb0 2020-07-16T20:30:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad88a69700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fad84065bc0 0x7fad8407f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:35818/0 (socket says 172.21.15.157:35818) 2020-07-16T20:30:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad88a69700 1 -- 172.21.15.157:0/3764628034 learned_addr learned my addr 172.21.15.157:0/3764628034 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.373+0000 7fad89a6b700 1 --2- 172.21.15.157:0/3764628034 >> v2:172.21.15.41:3300/0 conn(0x7fad8407fdb0 0x7fad84140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909640463 0 0) 0x7fad84065480 con 0x7fad84065bc0 2020-07-16T20:30:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c003240 con 0x7fad84065bc0 2020-07-16T20:30:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad89a6b700 1 -- 172.21.15.157:0/3764628034 >> v1:172.21.15.157:6789/0 conn(0x7fad84065bc0 legacy=0x7fad8407f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad89a6b700 1 -- 172.21.15.157:0/3764628034 >> v1:172.21.15.41:6789/0 conn(0x7fad84064790 legacy=0x7fad84134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad89a6b700 1 -- 172.21.15.157:0/3764628034 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840702f0 con 0x7fad8407fdb0 2020-07-16T20:30:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad89a6b700 1 --2- 172.21.15.157:0/3764628034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad8407fdb0 0x7fad84140290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad840ab5e0 tx=0x7fad7c0017f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c013a70 con 0x7fad8407fdb0 2020-07-16T20:30:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00d040 con 0x7fad8407fdb0 2020-07-16T20:30:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad84063690 con 0x7fad8407fdb0 2020-07-16T20:30:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c013bd0 con 0x7fad8407fdb0 2020-07-16T20:30:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.374+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad84064d30 con 0x7fad8407fdb0 2020-07-16T20:30:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.375+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fad7c01b020 con 0x7fad8407fdb0 2020-07-16T20:30:29.423 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.375+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fad7c0064d0 con 0x7fad8407fdb0 2020-07-16T20:30:29.423 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.376+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84057490 con 0x7fad8407fdb0 2020-07-16T20:30:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.378+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fad7c019020 con 0x7fad8407fdb0 2020-07-16T20:30:29.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.460+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fad84043fd0 con 0x7fad8407fdb0 2020-07-16T20:30:29.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.463+0000 7fad78ff9700 1 -- 172.21.15.157:0/3764628034 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fad7c013dd0 con 0x7fad8407fdb0 2020-07-16T20:30:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad8407fdb0 msgr2=0x7fad84140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 --2- 172.21.15.157:0/3764628034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad8407fdb0 0x7fad84140290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad840ab5e0 tx=0x7fad7c0017f0).stop 2020-07-16T20:30:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 shutdown_connections 2020-07-16T20:30:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 --2- 172.21.15.157:0/3764628034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad8407fdb0 0x7fad84140290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.472 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 >> 172.21.15.157:0/3764628034 conn(0x7fad8405b810 msgr2=0x7fad8409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:29.472 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 shutdown_connections 2020-07-16T20:30:29.472 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:29.464+0000 7fad8accd700 1 -- 172.21.15.157:0/3764628034 wait complete. 2020-07-16T20:30:29.472 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2020-07-16T20:30:29.479 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-07-16T20:30:29.480 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:29.510 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.pVklfO01JW 2020-07-16T20:30:29.511 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.pVklfO01JW 2020-07-16T20:30:29.587 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.pVklfO01JW 2020-07-16T20:30:29.730 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.pVklfO01JW is 37B 2020-07-16T20:30:29.804 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.pVklfO01JW 2020-07-16T20:30:29.823 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:29.877 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.VNYwMUGKAI 2020-07-16T20:30:29.877 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.VNYwMUGKAI 2020-07-16T20:30:29.945 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.VNYwMUGKAI 2020-07-16T20:30:30.076 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.VNYwMUGKAI is 37B 2020-07-16T20:30:30.125 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.VNYwMUGKAI 2020-07-16T20:30:30.140 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:30.195 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.hbBx4nsRKi 2020-07-16T20:30:30.195 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.hbBx4nsRKi 2020-07-16T20:30:30.264 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.hbBx4nsRKi 2020-07-16T20:30:30.390 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.hbBx4nsRKi is 37B 2020-07-16T20:30:30.454 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.hbBx4nsRKi 2020-07-16T20:30:30.484 INFO:teuthology.orchestra.run.smithi157:> mktemp 2020-07-16T20:30:30.536 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.tYfDkPeroZ 2020-07-16T20:30:30.537 INFO:teuthology.orchestra.run.smithi157:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.tYfDkPeroZ 2020-07-16T20:30:30.614 INFO:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.tYfDkPeroZ 2020-07-16T20:30:30.746 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.tYfDkPeroZ is 37B 2020-07-16T20:30:30.797 INFO:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.tYfDkPeroZ 2020-07-16T20:30:30.821 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:30.839 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.V5SzSBDiIt 2020-07-16T20:30:30.840 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.V5SzSBDiIt 2020-07-16T20:30:30.912 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.V5SzSBDiIt 2020-07-16T20:30:31.041 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.V5SzSBDiIt is 37B 2020-07-16T20:30:31.105 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.V5SzSBDiIt 2020-07-16T20:30:31.121 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:31.177 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.QFJItqbBeQ 2020-07-16T20:30:31.178 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.QFJItqbBeQ 2020-07-16T20:30:31.266 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.QFJItqbBeQ 2020-07-16T20:30:31.401 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.QFJItqbBeQ is 37B 2020-07-16T20:30:31.455 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.QFJItqbBeQ 2020-07-16T20:30:31.475 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:31.531 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.OKYJ8uQHQe 2020-07-16T20:30:31.531 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.OKYJ8uQHQe 2020-07-16T20:30:31.605 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.OKYJ8uQHQe 2020-07-16T20:30:31.738 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.OKYJ8uQHQe is 37B 2020-07-16T20:30:31.763 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.OKYJ8uQHQe 2020-07-16T20:30:31.778 INFO:teuthology.orchestra.run.smithi041:> mktemp 2020-07-16T20:30:31.832 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.LfDW6OSN1Y 2020-07-16T20:30:31.832 INFO:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.LfDW6OSN1Y 2020-07-16T20:30:31.904 INFO:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.LfDW6OSN1Y 2020-07-16T20:30:32.033 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.LfDW6OSN1Y is 37B 2020-07-16T20:30:32.090 INFO:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.LfDW6OSN1Y 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new 400d38af-3da6-4811-83e9-181b7a079aec 0 2020-07-16T20:30:32.262 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.258+0000 7fb126b9c700 1 Processor -- start 2020-07-16T20:30:32.263 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.258+0000 7fb126b9c700 1 -- start start 2020-07-16T20:30:32.263 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.258+0000 7fb126b9c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 0x7fb120067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.263 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1200a2d80 con 0x7fb12014e3f0 2020-07-16T20:30:32.264 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb120080c20 con 0x7fb1200807a0 2020-07-16T20:30:32.264 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a3660 con 0x7fb1200a5810 2020-07-16T20:30:32.264 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb12593a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb12014e3f0 0x7fb1201507e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34550/0 (socket says 172.21.15.41:34550) 2020-07-16T20:30:32.264 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb12593a700 1 -- 172.21.15.41:0/2964787782 learned_addr learned my addr 172.21.15.41:0/2964787782 (peer_addr_for_me v1:172.21.15.41:0/0) 2020-07-16T20:30:32.265 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb125139700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 0x7fb120067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.265 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb117fff700 1 -- 172.21.15.41:0/2964787782 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966987921 0 0) 0x7fb1200a2d80 con 0x7fb12014e3f0 2020-07-16T20:30:32.265 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb117fff700 1 -- 172.21.15.41:0/2964787782 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb10c003240 con 0x7fb12014e3f0 2020-07-16T20:30:32.266 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb125139700 1 -- 172.21.15.41:0/2964787782 >> v1:172.21.15.157:6789/0 conn(0x7fb1200807a0 legacy=0x7fb1200a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.266 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb125139700 1 -- 172.21.15.41:0/2964787782 >> v1:172.21.15.41:6789/0 conn(0x7fb12014e3f0 legacy=0x7fb1201507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.266 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb125139700 1 -- 172.21.15.41:0/2964787782 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200a38c0 con 0x7fb1200a5810 2020-07-16T20:30:32.267 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb125139700 1 --2- 172.21.15.41:0/2964787782 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 0x7fb120067c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb1200a2180 tx=0x7fb110006dd0).ready entity=mon.2 client_cookie=c54d302b07f9484d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.279 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb117fff700 1 -- 172.21.15.41:0/2964787782 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1100097b0 con 0x7fb1200a5810 2020-07-16T20:30:32.280 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb117fff700 1 -- 172.21.15.41:0/2964787782 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb110009910 con 0x7fb1200a5810 2020-07-16T20:30:32.280 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb117fff700 1 -- 172.21.15.41:0/2964787782 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb110009c70 con 0x7fb1200a5810 2020-07-16T20:30:32.280 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- 172.21.15.41:0/2964787782 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 msgr2=0x7fb120067c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.281 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 --2- 172.21.15.41:0/2964787782 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 0x7fb120067c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb1200a2180 tx=0x7fb110006dd0).stop 2020-07-16T20:30:32.281 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- 172.21.15.41:0/2964787782 shutdown_connections 2020-07-16T20:30:32.281 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 --2- 172.21.15.41:0/2964787782 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200a5810 0x7fb120067c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.282 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.259+0000 7fb126b9c700 1 -- 172.21.15.41:0/2964787782 >> 172.21.15.41:0/2964787782 conn(0x7fb12005b810 msgr2=0x7fb12005bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.282 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.260+0000 7fb126b9c700 1 -- 172.21.15.41:0/2964787782 shutdown_connections 2020-07-16T20:30:32.282 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.260+0000 7fb126b9c700 1 -- 172.21.15.41:0/2964787782 wait complete. 2020-07-16T20:30:32.286 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.261+0000 7fb126b9c700 1 Processor -- start 2020-07-16T20:30:32.287 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 -- start start 2020-07-16T20:30:32.287 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.287 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb12014e3f0 0x7fb1200651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.288 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb120062030 0x7fb120062480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.288 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1200670b0 con 0x7fb12014e3f0 2020-07-16T20:30:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb120067350 con 0x7fb120062030 2020-07-16T20:30:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb126b9c700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb120062970 con 0x7fb1200807a0 2020-07-16T20:30:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb125139700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb124938700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb12014e3f0 0x7fb1200651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb125139700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44446/0 (socket says 172.21.15.41:44446) 2020-07-16T20:30:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb125139700 1 -- 172.21.15.41:0/1408573861 learned_addr learned my addr 172.21.15.41:0/1408573861 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:32.291 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.262+0000 7fb12593a700 1 --2- 172.21.15.41:0/1408573861 >> v2:172.21.15.157:3300/0 conn(0x7fb120062030 0x7fb120062480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.291 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 -- 172.21.15.41:0/1408573861 >> v2:172.21.15.157:3300/0 conn(0x7fb120062030 msgr2=0x7fb120062480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.292 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 --2- 172.21.15.41:0/1408573861 >> v2:172.21.15.157:3300/0 conn(0x7fb120062030 0x7fb120062480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.292 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 -- 172.21.15.41:0/1408573861 >> v2:172.21.15.41:3300/0 conn(0x7fb12014e3f0 msgr2=0x7fb1200651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.292 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 --2- 172.21.15.41:0/1408573861 >> v2:172.21.15.41:3300/0 conn(0x7fb12014e3f0 0x7fb1200651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.293 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 -- 172.21.15.41:0/1408573861 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120062e60 con 0x7fb1200807a0 2020-07-16T20:30:32.293 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb125139700 1 --2- 172.21.15.41:0/1408573861 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb1200a2180 tx=0x7fb110015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.293 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11001e460 con 0x7fb1200807a0 2020-07-16T20:30:32.294 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11001e5c0 con 0x7fb1200807a0 2020-07-16T20:30:32.294 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1200656d0 con 0x7fb1200807a0 2020-07-16T20:30:32.294 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11001e920 con 0x7fb1200807a0 2020-07-16T20:30:32.295 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1201376d0 con 0x7fb1200807a0 2020-07-16T20:30:32.295 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fb110025030 con 0x7fb1200807a0 2020-07-16T20:30:32.295 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.263+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb110028a80 con 0x7fb1200807a0 2020-07-16T20:30:32.296 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.264+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb120057490 con 0x7fb1200807a0 2020-07-16T20:30:32.296 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.267+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fb110023070 con 0x7fb1200807a0 2020-07-16T20:30:32.362 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.358+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd new", "uuid": "400d38af-3da6-4811-83e9-181b7a079aec", "id": 0} v 0) v1 -- 0x7fb120043fd0 con 0x7fb1200807a0 2020-07-16T20:30:32.371 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.365+0000 7fb114ff9700 1 -- 172.21.15.41:0/1408573861 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "400d38af-3da6-4811-83e9-181b7a079aec", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb110031490 con 0x7fb1200807a0 2020-07-16T20:30:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 msgr2=0x7fb1200637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 --2- 172.21.15.41:0/1408573861 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb1200a2180 tx=0x7fb110015000).stop 2020-07-16T20:30:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 shutdown_connections 2020-07-16T20:30:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 --2- 172.21.15.41:0/1408573861 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb1200807a0 0x7fb1200637b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 --2- 172.21.15.41:0/1408573861 >> v2:172.21.15.157:3300/0 conn(0x7fb120062030 0x7fb120062480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 --2- 172.21.15.41:0/1408573861 >> v2:172.21.15.41:3300/0 conn(0x7fb12014e3f0 0x7fb1200651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 >> 172.21.15.41:0/1408573861 conn(0x7fb12005b810 msgr2=0x7fb12014dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 shutdown_connections 2020-07-16T20:30:32.375 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.366+0000 7fb126b9c700 1 -- 172.21.15.41:0/1408573861 wait complete. 2020-07-16T20:30:32.375 INFO:teuthology.orchestra.run.smithi041.stdout:0 2020-07-16T20:30:32.378 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new e326ac35-938c-4db2-b98e-59c797611374 1 2020-07-16T20:30:32.497 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 Processor -- start 2020-07-16T20:30:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 -- start start 2020-07-16T20:30:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9ff8067c20 0x7f9ff80807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80a2d80 con 0x7f9ff80a5810 2020-07-16T20:30:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80a3660 con 0x7f9ff814e3f0 2020-07-16T20:30:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7fa0002a8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80680d0 con 0x7f9ff8067c20 2020-07-16T20:30:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7f9ffe845700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9ff80a5810 0x7f9ff80a7da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34560/0 (socket says 172.21.15.41:34560) 2020-07-16T20:30:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.491+0000 7f9ffe845700 1 -- 172.21.15.41:0/3644234324 learned_addr learned my addr 172.21.15.41:0/3644234324 (peer_addr_for_me v1:172.21.15.41:0/0) 2020-07-16T20:30:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffe044700 1 --2- 172.21.15.41:0/3644234324 >> v2:172.21.15.157:3300/0 conn(0x7f9ff8067c20 0x7f9ff80807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.501 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337564194 0 0) 0x7f9ff80a2d80 con 0x7f9ff80a5810 2020-07-16T20:30:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec003240 con 0x7f9ff80a5810 2020-07-16T20:30:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48437216 0 0) 0x7f9ff80a3660 con 0x7f9ff814e3f0 2020-07-16T20:30:32.507 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff80a2d80 con 0x7f9ff814e3f0 2020-07-16T20:30:32.507 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2048041570 0 0) 0x7f9fec003240 con 0x7f9ff80a5810 2020-07-16T20:30:32.507 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffe044700 1 -- 172.21.15.41:0/3644234324 >> v1:172.21.15.157:6789/0 conn(0x7f9ff814e3f0 legacy=0x7f9ff81507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffe044700 1 -- 172.21.15.41:0/3644234324 >> v1:172.21.15.41:6789/0 conn(0x7f9ff80a5810 legacy=0x7f9ff80a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffe044700 1 -- 172.21.15.41:0/3644234324 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80a38c0 con 0x7f9ff8067c20 2020-07-16T20:30:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffe044700 1 --2- 172.21.15.41:0/3644234324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ff8067c20 0x7f9ff80807a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9ff40010d0 tx=0x7f9fe8006dd0).ready entity=mon.1 client_cookie=ee1b37f6c1851720 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff40016d0 con 0x7f9ff8067c20 2020-07-16T20:30:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe800d610 con 0x7f9ff8067c20 2020-07-16T20:30:32.513 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7f9ffd843700 1 -- 172.21.15.41:0/3644234324 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe800d780 con 0x7f9ff8067c20 2020-07-16T20:30:32.514 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 -- 172.21.15.41:0/3644234324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ff8067c20 msgr2=0x7f9ff80807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.514 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 --2- 172.21.15.41:0/3644234324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ff8067c20 0x7f9ff80807a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9ff40010d0 tx=0x7f9fe8006dd0).stop 2020-07-16T20:30:32.514 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 -- 172.21.15.41:0/3644234324 shutdown_connections 2020-07-16T20:30:32.515 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 --2- 172.21.15.41:0/3644234324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ff8067c20 0x7f9ff80807a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.515 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 -- 172.21.15.41:0/3644234324 >> 172.21.15.41:0/3644234324 conn(0x7f9ff805b810 msgr2=0x7f9ff805bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.515 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 -- 172.21.15.41:0/3644234324 shutdown_connections 2020-07-16T20:30:32.516 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.492+0000 7fa0002a8700 1 -- 172.21.15.41:0/3644234324 wait complete. 2020-07-16T20:30:32.516 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.494+0000 7fa0002a8700 1 Processor -- start 2020-07-16T20:30:32.516 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.494+0000 7fa0002a8700 1 -- start start 2020-07-16T20:30:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7fa0002a8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff814e3f0 0x7f9ff81344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7fa0002a8700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9ff812bf80 0x7f9ff814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7fa0002a8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff814e960 con 0x7f9ff81349b0 2020-07-16T20:30:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7fa0002a8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff814eb90 con 0x7f9ff814e3f0 2020-07-16T20:30:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7fa0002a8700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff814ee30 con 0x7f9ff812bf80 2020-07-16T20:30:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff814e3f0 0x7f9ff81344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff814e3f0 0x7f9ff81344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36162/0 (socket says 172.21.15.41:36162) 2020-07-16T20:30:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 -- 172.21.15.41:0/587128791 learned_addr learned my addr 172.21.15.41:0/587128791 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9fff046700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9ff812bf80 0x7f9ff814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 -- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9ff812bf80 msgr2=0x7f9ff814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9ff812bf80 0x7f9ff814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 -- 172.21.15.41:0/587128791 >> v1:172.21.15.41:6789/0 conn(0x7f9ff81349b0 legacy=0x7f9ff812b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287010910 0 0) 0x7f9ff814e960 con 0x7f9ff81349b0 2020-07-16T20:30:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 -- 172.21.15.41:0/587128791 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff814f0d0 con 0x7f9ff814e3f0 2020-07-16T20:30:32.529 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9ffe845700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff814e3f0 0x7f9ff81344c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9ff4000fa0 tx=0x7f9ff4001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.529 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.495+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff4007170 con 0x7f9ff814e3f0 2020-07-16T20:30:32.530 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40072d0 con 0x7f9ff814e3f0 2020-07-16T20:30:32.530 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff814f570 con 0x7f9ff814e3f0 2020-07-16T20:30:32.530 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff4004900 con 0x7f9ff814e3f0 2020-07-16T20:30:32.531 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8070530 con 0x7f9ff814e3f0 2020-07-16T20:30:32.531 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f9ff401b070 con 0x7f9ff814e3f0 2020-07-16T20:30:32.531 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f9ff4013bf0 con 0x7f9ff814e3f0 2020-07-16T20:30:32.532 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.496+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff814f260 con 0x7f9ff814e3f0 2020-07-16T20:30:32.532 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.498+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f9ff4032a00 con 0x7f9ff814e3f0 2020-07-16T20:30:32.549 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.541+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f9ff4010020 con 0x7f9ff814e3f0 2020-07-16T20:30:32.597 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.593+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e326ac35-938c-4db2-b98e-59c797611374", "id": 1} v 0) v1 -- 0x7f9ff8057490 con 0x7f9ff814e3f0 2020-07-16T20:30:32.599 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.597+0000 7f9fe67fc700 1 -- 172.21.15.41:0/587128791 <== mon.0 v2:172.21.15.41:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e326ac35-938c-4db2-b98e-59c797611374", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ff4010d10 con 0x7f9ff814e3f0 2020-07-16T20:30:32.599 INFO:teuthology.orchestra.run.smithi041.stdout:1 2020-07-16T20:30:32.601 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff814e3f0 msgr2=0x7f9ff81344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.601 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff814e3f0 0x7f9ff81344c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9ff4000fa0 tx=0x7f9ff4001280).stop 2020-07-16T20:30:32.601 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 shutdown_connections 2020-07-16T20:30:32.604 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9ff812bf80 0x7f9ff814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.605 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 --2- 172.21.15.41:0/587128791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff814e3f0 0x7f9ff81344c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.605 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 >> 172.21.15.41:0/587128791 conn(0x7f9ff805b810 msgr2=0x7f9ff809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.605 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 shutdown_connections 2020-07-16T20:30:32.606 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.598+0000 7fa0002a8700 1 -- 172.21.15.41:0/587128791 wait complete. 2020-07-16T20:30:32.610 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new 7340b5ba-43d8-4772-8679-9b2aced5930c 2 2020-07-16T20:30:32.756 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 Processor -- start 2020-07-16T20:30:32.758 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 -- start start 2020-07-16T20:30:32.758 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.761 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.762 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0a2d80 con 0x7feffc0a5810 2020-07-16T20:30:32.762 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0680a0 con 0x7feffc14e3f0 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7ff000af4700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0a3660 con 0x7feffc067c20 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.748+0000 7feffa59c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44462/0 (socket says 172.21.15.41:44462) 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 -- 172.21.15.41:0/2879307273 learned_addr learned my addr 172.21.15.41:0/2879307273 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffb59e700 1 --2- 172.21.15.41:0/2879307273 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 -- 172.21.15.41:0/2879307273 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 msgr2=0x7feffc1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.765 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 --2- 172.21.15.41:0/2879307273 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc1507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.765 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 -- 172.21.15.41:0/2879307273 >> v1:172.21.15.157:6789/0 conn(0x7feffc0a5810 legacy=0x7feffc0a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.771 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 -- 172.21.15.41:0/2879307273 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0a38c0 con 0x7feffc067c20 2020-07-16T20:30:32.771 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffb59e700 1 --2- 172.21.15.41:0/2879307273 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc1507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feffa59c700 1 --2- 172.21.15.41:0/2879307273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feffc0a2180 tx=0x7feff0006e90).ready entity=mon.2 client_cookie=b64df088149fe780 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feff9d9b700 1 -- 172.21.15.41:0/2879307273 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff0009810 con 0x7feffc067c20 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feff9d9b700 1 -- 172.21.15.41:0/2879307273 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0009970 con 0x7feffc067c20 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7feff9d9b700 1 -- 172.21.15.41:0/2879307273 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff0009cd0 con 0x7feffc067c20 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 -- 172.21.15.41:0/2879307273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 msgr2=0x7feffc0807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 --2- 172.21.15.41:0/2879307273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feffc0a2180 tx=0x7feff0006e90).stop 2020-07-16T20:30:32.774 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 -- 172.21.15.41:0/2879307273 shutdown_connections 2020-07-16T20:30:32.774 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 --2- 172.21.15.41:0/2879307273 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc1507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.774 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 --2- 172.21.15.41:0/2879307273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc067c20 0x7feffc0807a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.775 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 -- 172.21.15.41:0/2879307273 >> 172.21.15.41:0/2879307273 conn(0x7feffc05b810 msgr2=0x7feffc05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.775 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 -- 172.21.15.41:0/2879307273 shutdown_connections 2020-07-16T20:30:32.775 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.749+0000 7ff000af4700 1 -- 172.21.15.41:0/2879307273 wait complete. 2020-07-16T20:30:32.776 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 Processor -- start 2020-07-16T20:30:32.776 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 -- start start 2020-07-16T20:30:32.776 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc066f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 0x7feffc139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc080240 con 0x7feffc138eb0 2020-07-16T20:30:32.791 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0716a0 con 0x7feffc14e3f0 2020-07-16T20:30:32.791 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.751+0000 7ff000af4700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc066a90 con 0x7feffc065e10 2020-07-16T20:30:32.792 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.792 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffb59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 0x7feffc139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44470/0 (socket says 172.21.15.41:44470) 2020-07-16T20:30:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 -- 172.21.15.41:0/386623431 learned_addr learned my addr 172.21.15.41:0/386623431 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffad9d700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 -- 172.21.15.41:0/386623431 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 msgr2=0x7feffc066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 -- 172.21.15.41:0/386623431 >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 msgr2=0x7feffc139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.797 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 0x7feffc139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.797 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 -- 172.21.15.41:0/386623431 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0aa790 con 0x7feffc065e10 2020-07-16T20:30:32.798 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffb59e700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 0x7feffc139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:32.798 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffad9d700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:32.806 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7feffa59c700 1 --2- 172.21.15.41:0/386623431 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7feffc0a2180 tx=0x7feff0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.807 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff0021070 con 0x7feffc065e10 2020-07-16T20:30:32.807 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0009d30 con 0x7feffc065e10 2020-07-16T20:30:32.808 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc0662f0 con 0x7feffc065e10 2020-07-16T20:30:32.808 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff0009810 con 0x7feffc065e10 2020-07-16T20:30:32.808 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.752+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc1399d0 con 0x7feffc065e10 2020-07-16T20:30:32.809 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.753+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7feff000f070 con 0x7feffc065e10 2020-07-16T20:30:32.809 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.753+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1360+0+0 (secure 0 0 0) 0x7feff0039a00 con 0x7feffc065e10 2020-07-16T20:30:32.809 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.753+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc0668d0 con 0x7feffc065e10 2020-07-16T20:30:32.809 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.755+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7feff001b930 con 0x7feffc065e10 2020-07-16T20:30:32.846 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.844+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7340b5ba-43d8-4772-8679-9b2aced5930c", "id": 2} v 0) v1 -- 0x7feffc057490 con 0x7feffc065e10 2020-07-16T20:30:32.865 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.848+0000 7fefe27fc700 1 -- 172.21.15.41:0/386623431 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7340b5ba-43d8-4772-8679-9b2aced5930c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feff001b340 con 0x7feffc065e10 2020-07-16T20:30:32.865 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 msgr2=0x7feffc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.866 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 --2- 172.21.15.41:0/386623431 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7feffc0a2180 tx=0x7feff0015000).stop 2020-07-16T20:30:32.866 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 shutdown_connections 2020-07-16T20:30:32.866 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.41:3300/0 conn(0x7feffc138eb0 0x7feffc139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 --2- 172.21.15.41:0/386623431 >> v2:172.21.15.157:3300/0 conn(0x7feffc14e3f0 0x7feffc066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 --2- 172.21.15.41:0/386623431 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7feffc065e10 0x7feffc0a60f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.867 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 >> 172.21.15.41:0/386623431 conn(0x7feffc05b810 msgr2=0x7feffc09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.868 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 shutdown_connections 2020-07-16T20:30:32.868 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.849+0000 7ff000af4700 1 -- 172.21.15.41:0/386623431 wait complete. 2020-07-16T20:30:32.868 INFO:teuthology.orchestra.run.smithi041.stdout:2 2020-07-16T20:30:32.870 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new f9aa3b98-7cdf-481f-9e9b-86808c472d1a 3 2020-07-16T20:30:33.000 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.996+0000 7fa3585aa700 1 Processor -- start 2020-07-16T20:30:33.001 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.996+0000 7fa3585aa700 1 -- start start 2020-07-16T20:30:33.001 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa3585aa700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa3500a5810 0x7fa350067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.001 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa3585aa700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa3500807a0 0x7fa3500a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.002 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa3585aa700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500a2d80 con 0x7fa3500a8290 2020-07-16T20:30:33.002 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa3585aa700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa350080c50 con 0x7fa3500807a0 2020-07-16T20:30:33.002 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa3585aa700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3500a8700 con 0x7fa3500a5810 2020-07-16T20:30:33.002 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa3500807a0 0x7fa3500a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.002 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa3500807a0 0x7fa3500a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36182/0 (socket says 172.21.15.41:36182) 2020-07-16T20:30:33.003 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 -- 172.21.15.41:0/2264539369 learned_addr learned my addr 172.21.15.41:0/2264539369 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.003 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356b47700 1 --2- 172.21.15.41:0/2264539369 >> v2:172.21.15.157:3300/0 conn(0x7fa3500a5810 0x7fa350067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.003 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 -- 172.21.15.41:0/2264539369 >> v2:172.21.15.157:3300/0 conn(0x7fa3500a5810 msgr2=0x7fa350067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.003 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 --2- 172.21.15.41:0/2264539369 >> v2:172.21.15.157:3300/0 conn(0x7fa3500a5810 0x7fa350067c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.003 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 -- 172.21.15.41:0/2264539369 >> v1:172.21.15.157:6789/0 conn(0x7fa3500a8290 legacy=0x7fa3500a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.004 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 -- 172.21.15.41:0/2264539369 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3500a3660 con 0x7fa3500807a0 2020-07-16T20:30:33.004 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa356346700 1 --2- 172.21.15.41:0/2264539369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa3500807a0 0x7fa3500a7da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa34c002f30 tx=0x7fa34c006e90).ready entity=mon.0 client_cookie=d7bfc62cffdbbdcd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.004 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.997+0000 7fa355b45700 1 -- 172.21.15.41:0/2264539369 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa34c009850 con 0x7fa3500807a0 2020-07-16T20:30:33.004 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa355b45700 1 -- 172.21.15.41:0/2264539369 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0099b0 con 0x7fa3500807a0 2020-07-16T20:30:33.004 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa355b45700 1 -- 172.21.15.41:0/2264539369 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa34c009d10 con 0x7fa3500807a0 2020-07-16T20:30:33.005 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 -- 172.21.15.41:0/2264539369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa3500807a0 msgr2=0x7fa3500a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.005 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 --2- 172.21.15.41:0/2264539369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa3500807a0 0x7fa3500a7da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa34c002f30 tx=0x7fa34c006e90).stop 2020-07-16T20:30:33.005 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 -- 172.21.15.41:0/2264539369 shutdown_connections 2020-07-16T20:30:33.005 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 --2- 172.21.15.41:0/2264539369 >> v2:172.21.15.157:3300/0 conn(0x7fa3500a5810 0x7fa350067c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 --2- 172.21.15.41:0/2264539369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa3500807a0 0x7fa3500a7da0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 -- 172.21.15.41:0/2264539369 >> 172.21.15.41:0/2264539369 conn(0x7fa35005b810 msgr2=0x7fa35005bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 -- 172.21.15.41:0/2264539369 shutdown_connections 2020-07-16T20:30:33.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.998+0000 7fa3585aa700 1 -- 172.21.15.41:0/2264539369 wait complete. 2020-07-16T20:30:33.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.999+0000 7fa3585aa700 1 Processor -- start 2020-07-16T20:30:33.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:32.999+0000 7fa3585aa700 1 -- start start 2020-07-16T20:30:33.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa3585aa700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa350067360 0x7fa35009f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa3585aa700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500a1de0 con 0x7fa3500a1290 2020-07-16T20:30:33.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa3585aa700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500a9540 con 0x7fa3500a8290 2020-07-16T20:30:33.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa3585aa700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35009fdb0 con 0x7fa350067360 2020-07-16T20:30:33.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa357348700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa3500a1290 0x7fa350123760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34592/0 (socket says 172.21.15.41:34592) 2020-07-16T20:30:33.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa357348700 1 -- 172.21.15.41:0/483019959 learned_addr learned my addr 172.21.15.41:0/483019959 (peer_addr_for_me v1:172.21.15.41:0/0) 2020-07-16T20:30:33.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa356346700 1 --2- 172.21.15.41:0/483019959 >> v2:172.21.15.157:3300/0 conn(0x7fa350067360 0x7fa35009f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981256273 0 0) 0x7fa3500a1de0 con 0x7fa3500a1290 2020-07-16T20:30:33.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa330003240 con 0x7fa3500a1290 2020-07-16T20:30:33.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123348882 0 0) 0x7fa3500a9540 con 0x7fa3500a8290 2020-07-16T20:30:33.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa356346700 1 -- 172.21.15.41:0/483019959 >> v1:172.21.15.157:6789/0 conn(0x7fa3500a8290 legacy=0x7fa350066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa356346700 1 -- 172.21.15.41:0/483019959 >> v1:172.21.15.41:6789/0 conn(0x7fa3500a1290 legacy=0x7fa350123760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.000+0000 7fa356346700 1 -- 172.21.15.41:0/483019959 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3500a97e0 con 0x7fa350067360 2020-07-16T20:30:33.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa356346700 1 --2- 172.21.15.41:0/483019959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa350067360 0x7fa35009f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa34c002f30 tx=0x7fa34c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa34c009d70 con 0x7fa350067360 2020-07-16T20:30:33.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c011e80 con 0x7fa350067360 2020-07-16T20:30:33.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3500a9a80 con 0x7fa350067360 2020-07-16T20:30:33.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa34c01d7c0 con 0x7fa350067360 2020-07-16T20:30:33.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa350123e70 con 0x7fa350067360 2020-07-16T20:30:33.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.001+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7fa34c025030 con 0x7fa350067360 2020-07-16T20:30:33.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.002+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1499+0+0 (secure 0 0 0) 0x7fa34c039cf0 con 0x7fa350067360 2020-07-16T20:30:33.020 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.002+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3500a9c10 con 0x7fa350067360 2020-07-16T20:30:33.020 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.004+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fa34c023020 con 0x7fa350067360 2020-07-16T20:30:33.095 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.094+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9aa3b98-7cdf-481f-9e9b-86808c472d1a", "id": 3} v 0) v1 -- 0x7fa350057490 con 0x7fa350067360 2020-07-16T20:30:33.100 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa33a7fc700 1 -- 172.21.15.41:0/483019959 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9aa3b98-7cdf-481f-9e9b-86808c472d1a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa34c023030 con 0x7fa350067360 2020-07-16T20:30:33.100 INFO:teuthology.orchestra.run.smithi041.stdout:3 2020-07-16T20:30:33.102 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa350067360 msgr2=0x7fa35009f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.102 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa3585aa700 1 --2- 172.21.15.41:0/483019959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa350067360 0x7fa35009f380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa34c002f30 tx=0x7fa34c015000).stop 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 shutdown_connections 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa3585aa700 1 --2- 172.21.15.41:0/483019959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa350067360 0x7fa35009f380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.098+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 >> 172.21.15.41:0/483019959 conn(0x7fa35005b810 msgr2=0x7fa3500aa540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.104 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.099+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 shutdown_connections 2020-07-16T20:30:33.104 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.099+0000 7fa3585aa700 1 -- 172.21.15.41:0/483019959 wait complete. 2020-07-16T20:30:33.111 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new 6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c 4 2020-07-16T20:30:33.227 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.222+0000 7f7a3e6c0700 1 Processor -- start 2020-07-16T20:30:33.227 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.222+0000 7f7a3e6c0700 1 -- start start 2020-07-16T20:30:33.228 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3e6c0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a5810 0x7f7a38067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.228 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3e6c0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 0x7f7a381507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.228 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3e6c0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a380a2d80 con 0x7f7a380807a0 2020-07-16T20:30:33.229 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3e6c0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a38080c50 con 0x7f7a380a5810 2020-07-16T20:30:33.229 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3e6c0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380a3660 con 0x7f7a3814e3f0 2020-07-16T20:30:33.229 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a5810 0x7f7a38067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.230 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a5810 0x7f7a38067c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36192/0 (socket says 172.21.15.41:36192) 2020-07-16T20:30:33.230 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 -- 172.21.15.41:0/4244481751 learned_addr learned my addr 172.21.15.41:0/4244481751 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.230 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3d45e700 1 --2- 172.21.15.41:0/4244481751 >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 0x7f7a381507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.231 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 -- 172.21.15.41:0/4244481751 >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 msgr2=0x7f7a381507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.231 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 --2- 172.21.15.41:0/4244481751 >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 0x7f7a381507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.232 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 -- 172.21.15.41:0/4244481751 >> v1:172.21.15.157:6789/0 conn(0x7f7a380807a0 legacy=0x7f7a380a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.232 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3cc5d700 1 -- 172.21.15.41:0/4244481751 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380a38c0 con 0x7f7a380a5810 2020-07-16T20:30:33.232 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.223+0000 7f7a3d45e700 1 --2- 172.21.15.41:0/4244481751 >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 0x7f7a381507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:33.233 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3cc5d700 1 --2- 172.21.15.41:0/4244481751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a5810 0x7f7a38067c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7a380a4ce0 tx=0x7f7a28006e90).ready entity=mon.0 client_cookie=68aa350f5a5bb6f0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.233 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a377fe700 1 -- 172.21.15.41:0/4244481751 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a28009930 con 0x7f7a380a5810 2020-07-16T20:30:33.233 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a377fe700 1 -- 172.21.15.41:0/4244481751 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28009a90 con 0x7f7a380a5810 2020-07-16T20:30:33.233 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a377fe700 1 -- 172.21.15.41:0/4244481751 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a28009e30 con 0x7f7a380a5810 2020-07-16T20:30:33.234 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4244481751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a5810 msgr2=0x7f7a38067c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.249 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 --2- 172.21.15.41:0/4244481751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a5810 0x7f7a38067c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7a380a4ce0 tx=0x7f7a28006e90).stop 2020-07-16T20:30:33.250 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4244481751 shutdown_connections 2020-07-16T20:30:33.250 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 --2- 172.21.15.41:0/4244481751 >> v2:172.21.15.157:3300/0 conn(0x7f7a3814e3f0 0x7f7a381507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.251 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 --2- 172.21.15.41:0/4244481751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a5810 0x7f7a38067c20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.251 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4244481751 >> 172.21.15.41:0/4244481751 conn(0x7f7a3805b810 msgr2=0x7f7a3805bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.252 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4244481751 shutdown_connections 2020-07-16T20:30:33.252 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.224+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4244481751 wait complete. 2020-07-16T20:30:33.252 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.225+0000 7f7a3e6c0700 1 Processor -- start 2020-07-16T20:30:33.256 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3e6c0700 1 -- start start 2020-07-16T20:30:33.256 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3e6c0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a1420 0x7f7a380a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.256 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3e6c0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a38064010 con 0x7f7a380807a0 2020-07-16T20:30:33.257 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3e6c0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a380a6b60 con 0x7f7a3814e3f0 2020-07-16T20:30:33.257 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3e6c0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a38064250 con 0x7f7a380a1420 2020-07-16T20:30:33.274 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3d45e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a1420 0x7f7a380a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.275 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3d45e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7a380a1420 0x7f7a380a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36202/0 (socket says 172.21.15.41:36202) 2020-07-16T20:30:33.275 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3d45e700 1 -- 172.21.15.41:0/4135213077 learned_addr learned my addr 172.21.15.41:0/4135213077 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.276 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.226+0000 7f7a3d45e700 1 -- 172.21.15.41:0/4135213077 >> v1:172.21.15.157:6789/0 conn(0x7f7a3814e3f0 legacy=0x7f7a3807fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.276 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a3d45e700 1 -- 172.21.15.41:0/4135213077 >> v1:172.21.15.41:6789/0 conn(0x7f7a380807a0 legacy=0x7f7a38061cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.276 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a3d45e700 1 -- 172.21.15.41:0/4135213077 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380a0ce0 con 0x7f7a380a1420 2020-07-16T20:30:33.277 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a3d45e700 1 --2- 172.21.15.41:0/4135213077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a1420 0x7f7a380a6180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7a38063ae0 tx=0x7f7a30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.277 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a30015070 con 0x7f7a380a1420 2020-07-16T20:30:33.278 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30007890 con 0x7f7a380a1420 2020-07-16T20:30:33.278 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a380a0f80 con 0x7f7a380a1420 2020-07-16T20:30:33.278 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a30007bf0 con 0x7f7a380a1420 2020-07-16T20:30:33.279 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a38080250 con 0x7f7a380a1420 2020-07-16T20:30:33.279 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.227+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f7a3001a410 con 0x7f7a380a1420 2020-07-16T20:30:33.279 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.228+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1614+0+0 (secure 0 0 0) 0x7f7a30038ac0 con 0x7f7a380a1420 2020-07-16T20:30:33.280 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.228+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a38057490 con 0x7f7a380a1420 2020-07-16T20:30:33.280 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.230+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f7a30011410 con 0x7f7a380a1420 2020-07-16T20:30:33.320 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.319+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c", "id": 4} v 0) v1 -- 0x7f7a380a1110 con 0x7f7a380a1420 2020-07-16T20:30:33.323 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.322+0000 7f7a17fff700 1 -- 172.21.15.41:0/4135213077 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a300172c0 con 0x7f7a380a1420 2020-07-16T20:30:33.324 INFO:teuthology.orchestra.run.smithi041.stdout:4 2020-07-16T20:30:33.326 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.322+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a1420 msgr2=0x7f7a380a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.326 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.322+0000 7f7a3e6c0700 1 --2- 172.21.15.41:0/4135213077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a1420 0x7f7a380a6180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7a38063ae0 tx=0x7f7a30008040).stop 2020-07-16T20:30:33.327 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.323+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 shutdown_connections 2020-07-16T20:30:33.327 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.323+0000 7f7a3e6c0700 1 --2- 172.21.15.41:0/4135213077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a380a1420 0x7f7a380a6180 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.327 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.323+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 >> 172.21.15.41:0/4135213077 conn(0x7f7a3805b810 msgr2=0x7f7a380a9430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.328 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.323+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 shutdown_connections 2020-07-16T20:30:33.328 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.323+0000 7f7a3e6c0700 1 -- 172.21.15.41:0/4135213077 wait complete. 2020-07-16T20:30:33.337 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new d9925dee-95e0-4346-b7b9-e0cf396e8538 5 2020-07-16T20:30:33.455 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 Processor -- start 2020-07-16T20:30:33.455 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 -- start start 2020-07-16T20:30:33.456 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad009f480 0x7f0ad0067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.456 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.456 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad009e880 con 0x7f0ad009f0a0 2020-07-16T20:30:33.457 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad009eb20 con 0x7f0ad009f480 2020-07-16T20:30:33.457 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.451+0000 7f0ad6ba2700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00a7800 con 0x7f0ad014e8b0 2020-07-16T20:30:33.457 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad7e04700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.458 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad009f480 0x7f0ad0067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.459 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad009f480 0x7f0ad0067dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36204/0 (socket says 172.21.15.41:36204) 2020-07-16T20:30:33.459 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad7e04700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44502/0 (socket says 172.21.15.41:44502) 2020-07-16T20:30:33.459 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 -- 172.21.15.41:0/162116725 learned_addr learned my addr 172.21.15.41:0/162116725 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.459 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 -- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 msgr2=0x7f0ad0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.460 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.460 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 -- 172.21.15.41:0/162116725 >> v1:172.21.15.41:6789/0 conn(0x7f0ad009f0a0 legacy=0x7f0ad00676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.461 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 -- 172.21.15.41:0/162116725 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00a88c0 con 0x7f0ad009f480 2020-07-16T20:30:33.461 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad7e04700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:33.461 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad5ba0700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ad009f480 0x7f0ad0067dc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ac0002f30 tx=0x7f0ac0006e90).ready entity=mon.0 client_cookie=fb619ff19f14e5f2 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.471 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad539f700 1 -- 172.21.15.41:0/162116725 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac0009850 con 0x7f0ad009f480 2020-07-16T20:30:33.471 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad539f700 1 -- 172.21.15.41:0/162116725 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00099b0 con 0x7f0ad009f480 2020-07-16T20:30:33.472 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad539f700 1 -- 172.21.15.41:0/162116725 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac0009d10 con 0x7f0ad009f480 2020-07-16T20:30:33.472 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ad009f480 msgr2=0x7f0ad0067dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.472 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ad009f480 0x7f0ad0067dc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ac0002f30 tx=0x7f0ac0006e90).stop 2020-07-16T20:30:33.473 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/162116725 shutdown_connections 2020-07-16T20:30:33.473 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad014e8b0 0x7f0ad0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.473 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/162116725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ad009f480 0x7f0ad0067dc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.474 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/162116725 >> 172.21.15.41:0/162116725 conn(0x7f0ad0062a50 msgr2=0x7f0ad006abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.474 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/162116725 shutdown_connections 2020-07-16T20:30:33.474 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.452+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/162116725 wait complete. 2020-07-16T20:30:33.478 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.454+0000 7f0ad6ba2700 1 Processor -- start 2020-07-16T20:30:33.478 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.454+0000 7f0ad6ba2700 1 -- start start 2020-07-16T20:30:33.486 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 0x7f0ad0125260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.486 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.487 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ad00a56a0 0x7f0ad00a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.487 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00a3940 con 0x7f0ad014e8b0 2020-07-16T20:30:33.487 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00a3b50 con 0x7f0ad00a56a0 2020-07-16T20:30:33.488 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00a20d0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.488 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad5ba0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.489 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 0x7f0ad0125260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.489 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad5ba0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36212/0 (socket says 172.21.15.41:36212) 2020-07-16T20:30:33.489 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad5ba0700 1 -- 172.21.15.41:0/867496229 learned_addr learned my addr 172.21.15.41:0/867496229 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.490 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad7e04700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.157:3300/0 conn(0x7f0ad00a56a0 0x7f0ad00a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.490 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 -- 172.21.15.41:0/867496229 >> v2:172.21.15.157:3300/0 conn(0x7f0ad00a56a0 msgr2=0x7f0ad00a2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.490 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.157:3300/0 conn(0x7f0ad00a56a0 0x7f0ad00a2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 -- 172.21.15.41:0/867496229 >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 msgr2=0x7f0ad00a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 -- 172.21.15.41:0/867496229 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00a3570 con 0x7f0ad009f0a0 2020-07-16T20:30:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad5ba0700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad63a1700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 0x7f0ad0125260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0ad0063110 tx=0x7f0acc007b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.493 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0acc007240 con 0x7f0ad009f0a0 2020-07-16T20:30:33.493 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0073a0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.494 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0acc0066e0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.494 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.455+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad00a2a60 con 0x7f0ad009f0a0 2020-07-16T20:30:33.494 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.456+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad007fa50 con 0x7f0ad009f0a0 2020-07-16T20:30:33.495 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.456+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f0acc006840 con 0x7f0ad009f0a0 2020-07-16T20:30:33.495 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.456+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f0acc03a2c0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.495 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.456+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0057490 con 0x7f0ad009f0a0 2020-07-16T20:30:33.496 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.458+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f0acc0172b0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.558 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.547+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7f0acc011990 con 0x7f0ad009f0a0 2020-07-16T20:30:33.559 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.547+0000 7f0ac5ffb700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 0x7f0ab0053070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.559 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.547+0000 7f0ad5ba0700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 0x7f0ab0053070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.560 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.548+0000 7f0ad5ba0700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 0x7f0ab0053070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0ac001c000 tx=0x7f0ac0015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.560 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.550+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d9925dee-95e0-4346-b7b9-e0cf396e8538", "id": 5} v 0) v1 -- 0x7f0ad00a2240 con 0x7f0ad009f0a0 2020-07-16T20:30:33.560 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.553+0000 7f0ac5ffb700 1 -- 172.21.15.41:0/867496229 <== mon.2 v2:172.21.15.41:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9925dee-95e0-4346-b7b9-e0cf396e8538", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0acc0447c0 con 0x7f0ad009f0a0 2020-07-16T20:30:33.561 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 msgr2=0x7f0ab0053070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.561 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 0x7f0ab0053070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0ac001c000 tx=0x7f0ac0015000).stop 2020-07-16T20:30:33.562 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 msgr2=0x7f0ad0125260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.562 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 0x7f0ad0125260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0ad0063110 tx=0x7f0acc007b30).stop 2020-07-16T20:30:33.562 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 shutdown_connections 2020-07-16T20:30:33.562 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0ab0050c80 0x7f0ab0053070 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.563 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0ad009f0a0 0x7f0ad0125260 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.563 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.157:3300/0 conn(0x7f0ad00a56a0 0x7f0ad00a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.563 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 --2- 172.21.15.41:0/867496229 >> v2:172.21.15.41:3300/0 conn(0x7f0ad014e8b0 0x7f0ad00a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.564 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 >> 172.21.15.41:0/867496229 conn(0x7f0ad0062a50 msgr2=0x7f0ad00ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.564 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 shutdown_connections 2020-07-16T20:30:33.565 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.554+0000 7f0ad6ba2700 1 -- 172.21.15.41:0/867496229 wait complete. 2020-07-16T20:30:33.565 INFO:teuthology.orchestra.run.smithi041.stdout:5 2020-07-16T20:30:33.574 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new 778458a4-92c9-4394-b239-d95ac82ca4ea 6 2020-07-16T20:30:33.695 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.685+0000 7f71d748e700 1 Processor -- start 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.685+0000 7f71d748e700 1 -- start start 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00807a0 0x7f71d00a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00a8720 con 0x7f71d00807a0 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00a2d80 con 0x7f71d00a8290 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d748e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0080c20 con 0x7f71d00a5810 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d5a2b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00807a0 0x7f71d00a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00807a0 0x7f71d00a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36224/0 (socket says 172.21.15.41:36224) 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d5a2b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44518/0 (socket says 172.21.15.41:44518) 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 -- 172.21.15.41:0/3730480990 learned_addr learned my addr 172.21.15.41:0/3730480990 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d622c700 1 --2- 172.21.15.41:0/3730480990 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 -- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 msgr2=0x7f71d0067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 -- 172.21.15.41:0/3730480990 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 msgr2=0x7f71d00a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.686+0000 7f71d522a700 1 --2- 172.21.15.41:0/3730480990 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d522a700 1 -- 172.21.15.41:0/3730480990 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00a3660 con 0x7f71d00807a0 2020-07-16T20:30:33.705 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d622c700 1 --2- 172.21.15.41:0/3730480990 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:33.705 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d5a2b700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:33.705 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d522a700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00807a0 0x7f71d00a7da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f71d00a4ce0 tx=0x7f71c0006e90).ready entity=mon.0 client_cookie=c8b0dbc8839a7fce server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.707 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d4a29700 1 -- 172.21.15.41:0/3730480990 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0009810 con 0x7f71d00807a0 2020-07-16T20:30:33.707 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d4a29700 1 -- 172.21.15.41:0/3730480990 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0009970 con 0x7f71d00807a0 2020-07-16T20:30:33.708 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d4a29700 1 -- 172.21.15.41:0/3730480990 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0009cd0 con 0x7f71d00807a0 2020-07-16T20:30:33.708 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 -- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00807a0 msgr2=0x7f71d00a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.708 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00807a0 0x7f71d00a7da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f71d00a4ce0 tx=0x7f71c0006e90).stop 2020-07-16T20:30:33.709 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 -- 172.21.15.41:0/3730480990 shutdown_connections 2020-07-16T20:30:33.709 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d00a5810 0x7f71d0067c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.709 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 --2- 172.21.15.41:0/3730480990 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.710 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 --2- 172.21.15.41:0/3730480990 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00807a0 0x7f71d00a7da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.710 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 -- 172.21.15.41:0/3730480990 >> 172.21.15.41:0/3730480990 conn(0x7f71d005b810 msgr2=0x7f71d005bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.710 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 -- 172.21.15.41:0/3730480990 shutdown_connections 2020-07-16T20:30:33.711 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.687+0000 7f71d748e700 1 -- 172.21.15.41:0/3730480990 wait complete. 2020-07-16T20:30:33.711 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.688+0000 7f71d748e700 1 Processor -- start 2020-07-16T20:30:33.711 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 -- start start 2020-07-16T20:30:33.712 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.712 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.712 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00637d0 0x7f71d0124d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.713 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d0125220 con 0x7f71d00637d0 2020-07-16T20:30:33.713 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d012cd50 con 0x7f71d00a8290 2020-07-16T20:30:33.713 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d748e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0063d50 con 0x7f71d0065ca0 2020-07-16T20:30:33.714 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d522a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.714 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d622c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00637d0 0x7f71d0124d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.715 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d622c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71d00637d0 0x7f71d0124d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36232/0 (socket says 172.21.15.41:36232) 2020-07-16T20:30:33.715 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d622c700 1 -- 172.21.15.41:0/1793886100 learned_addr learned my addr 172.21.15.41:0/1793886100 (peer_addr_for_me v2:172.21.15.41:0/0) 2020-07-16T20:30:33.715 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.689+0000 7f71d522a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.41:44522/0 (socket says 172.21.15.41:44522) 2020-07-16T20:30:33.715 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d5a2b700 1 --2- 172.21.15.41:0/1793886100 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.715 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 -- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 msgr2=0x7f71d0124840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.716 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.716 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 -- 172.21.15.41:0/1793886100 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 msgr2=0x7f71d00a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.716 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 --2- 172.21.15.41:0/1793886100 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.717 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 -- 172.21.15.41:0/1793886100 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0063ff0 con 0x7f71d00637d0 2020-07-16T20:30:33.717 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d522a700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:33.718 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d622c700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00637d0 0x7f71d0124d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f71d0064870 tx=0x7f71c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.718 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c800c8c0 con 0x7f71d00637d0 2020-07-16T20:30:33.718 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800ca20 con 0x7f71d00637d0 2020-07-16T20:30:33.719 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0064290 con 0x7f71d00637d0 2020-07-16T20:30:33.719 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c800cd80 con 0x7f71d00637d0 2020-07-16T20:30:33.719 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.690+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0135e80 con 0x7f71d00637d0 2020-07-16T20:30:33.720 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.691+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0057490 con 0x7f71d00637d0 2020-07-16T20:30:33.720 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.691+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7f71c801d460 con 0x7f71d00637d0 2020-07-16T20:30:33.720 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.691+0000 7f71c57fa700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 0x7f71a8052530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.721 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.691+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f71c8066d50 con 0x7f71d00637d0 2020-07-16T20:30:33.721 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.692+0000 7f71d5a2b700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 0x7f71a8052530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.721 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.692+0000 7f71d5a2b700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 0x7f71a8052530 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f71cc00b000 tx=0x7f71cc008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.722 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.695+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f71c8040740 con 0x7f71d00637d0 2020-07-16T20:30:33.871 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.870+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd new", "uuid": "778458a4-92c9-4394-b239-d95ac82ca4ea", "id": 6} v 0) v1 -- 0x7f71d0043fd0 con 0x7f71d00637d0 2020-07-16T20:30:33.874 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.873+0000 7f71c57fa700 1 -- 172.21.15.41:0/1793886100 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "778458a4-92c9-4394-b239-d95ac82ca4ea", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71c8043d60 con 0x7f71d00637d0 2020-07-16T20:30:33.875 INFO:teuthology.orchestra.run.smithi041.stdout:6 2020-07-16T20:30:33.883 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 msgr2=0x7f71a8052530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.883 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 0x7f71a8052530 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f71cc00b000 tx=0x7f71cc008040).stop 2020-07-16T20:30:33.884 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00637d0 msgr2=0x7f71d0124d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.884 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00637d0 0x7f71d0124d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f71d0064870 tx=0x7f71c8008040).stop 2020-07-16T20:30:33.884 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 shutdown_connections 2020-07-16T20:30:33.885 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f71a8050070 0x7f71a8052530 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.885 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71d00637d0 0x7f71d0124d30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.885 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> v2:172.21.15.157:3300/0 conn(0x7f71d00a8290 0x7f71d00a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 --2- 172.21.15.41:0/1793886100 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f71d0065ca0 0x7f71d0124840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.874+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 >> 172.21.15.41:0/1793886100 conn(0x7f71d005b810 msgr2=0x7f71d00aa540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.875+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 shutdown_connections 2020-07-16T20:30:33.887 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:33.875+0000 7f71d748e700 1 -- 172.21.15.41:0/1793886100 wait complete. 2020-07-16T20:30:33.888 INFO:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd new 2b74b7ca-1708-4096-8c95-c9eebefddf1e 7 2020-07-16T20:30:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.001+0000 7f4d7b479700 1 Processor -- start 2020-07-16T20:30:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.001+0000 7f4d7b479700 1 -- start start 2020-07-16T20:30:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7b479700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4d74067c20 0x7f4d740807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7b479700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d7414e3f0 0x7f4d741507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7b479700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d740a2d80 con 0x7f4d740a5810 2020-07-16T20:30:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7b479700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d740680d0 con 0x7f4d74067c20 2020-07-16T20:30:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7b479700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d740a3660 con 0x7f4d7414e3f0 2020-07-16T20:30:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4d74067c20 0x7f4d740807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79a16700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4d740a5810 0x7f4d740a7da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34638/0 (socket says 172.21.15.41:34638) 2020-07-16T20:30:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79a16700 1 -- 172.21.15.41:0/2035641139 learned_addr learned my addr 172.21.15.41:0/2035641139 (peer_addr_for_me v1:172.21.15.41:0/0) 2020-07-16T20:30:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 --2- 172.21.15.41:0/2035641139 >> v2:172.21.15.41:3300/0 conn(0x7f4d74067c20 0x7f4d740807a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36236/0 (socket says 172.21.15.41:36236) 2020-07-16T20:30:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d7a217700 1 --2- 172.21.15.41:0/2035641139 >> v2:172.21.15.157:3300/0 conn(0x7f4d7414e3f0 0x7f4d741507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 -- 172.21.15.41:0/2035641139 >> v2:172.21.15.157:3300/0 conn(0x7f4d7414e3f0 msgr2=0x7f4d741507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 --2- 172.21.15.41:0/2035641139 >> v2:172.21.15.157:3300/0 conn(0x7f4d7414e3f0 0x7f4d741507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 -- 172.21.15.41:0/2035641139 >> v1:172.21.15.41:6789/0 conn(0x7f4d740a5810 legacy=0x7f4d740a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 -- 172.21.15.41:0/2035641139 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740a38c0 con 0x7f4d74067c20 2020-07-16T20:30:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d78a14700 1 -- 172.21.15.41:0/2035641139 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738866538 0 0) 0x7f4d740a2d80 con 0x7f4d740a5810 2020-07-16T20:30:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d79215700 1 --2- 172.21.15.41:0/2035641139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d74067c20 0x7f4d740807a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64006dd0).ready entity=mon.0 client_cookie=64a2365898b4ae8d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d78a14700 1 -- 172.21.15.41:0/2035641139 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d640097f0 con 0x7f4d74067c20 2020-07-16T20:30:34.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d78a14700 1 -- 172.21.15.41:0/2035641139 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64009950 con 0x7f4d74067c20 2020-07-16T20:30:34.017 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.002+0000 7f4d78a14700 1 -- 172.21.15.41:0/2035641139 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d64009cb0 con 0x7f4d74067c20 2020-07-16T20:30:34.018 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 -- 172.21.15.41:0/2035641139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d74067c20 msgr2=0x7f4d740807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 --2- 172.21.15.41:0/2035641139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d74067c20 0x7f4d740807a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64006dd0).stop 2020-07-16T20:30:34.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 -- 172.21.15.41:0/2035641139 shutdown_connections 2020-07-16T20:30:34.019 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 --2- 172.21.15.41:0/2035641139 >> v2:172.21.15.157:3300/0 conn(0x7f4d7414e3f0 0x7f4d741507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.020 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 --2- 172.21.15.41:0/2035641139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d74067c20 0x7f4d740807a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.020 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 -- 172.21.15.41:0/2035641139 >> 172.21.15.41:0/2035641139 conn(0x7f4d7405b810 msgr2=0x7f4d7405bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.021 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 -- 172.21.15.41:0/2035641139 shutdown_connections 2020-07-16T20:30:34.021 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.003+0000 7f4d7b479700 1 -- 172.21.15.41:0/2035641139 wait complete. 2020-07-16T20:30:34.021 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.004+0000 7f4d7b479700 1 Processor -- start 2020-07-16T20:30:34.022 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.004+0000 7f4d7b479700 1 -- start start 2020-07-16T20:30:34.022 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7b479700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 0x7f4d740a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.022 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7b479700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d74067750 con 0x7f4d740672a0 2020-07-16T20:30:34.023 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7b479700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d74071980 con 0x7f4d7414e3f0 2020-07-16T20:30:34.023 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7b479700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740a6f70 con 0x7f4d740714e0 2020-07-16T20:30:34.023 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d79215700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 0x7f4d740a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.024 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7a217700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4d740672a0 0x7f4d741391e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34646/0 (socket says 172.21.15.41:34646) 2020-07-16T20:30:34.024 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d7a217700 1 -- 172.21.15.41:0/946489371 learned_addr learned my addr 172.21.15.41:0/946489371 (peer_addr_for_me v1:172.21.15.41:0/0) 2020-07-16T20:30:34.024 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466790352 0 0) 0x7f4d74067750 con 0x7f4d740672a0 2020-07-16T20:30:34.025 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c003240 con 0x7f4d740672a0 2020-07-16T20:30:34.025 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d79215700 1 -- 172.21.15.41:0/946489371 >> v1:172.21.15.157:6789/0 conn(0x7f4d7414e3f0 legacy=0x7f4d74065fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.025 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d79215700 1 -- 172.21.15.41:0/946489371 >> v1:172.21.15.41:6789/0 conn(0x7f4d740672a0 legacy=0x7f4d741391e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.026 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.005+0000 7f4d79215700 1 -- 172.21.15.41:0/946489371 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74071c20 con 0x7f4d740714e0 2020-07-16T20:30:34.026 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d79215700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 0x7f4d740a61a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.026 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d64011e80 con 0x7f4d740714e0 2020-07-16T20:30:34.027 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d74065b20 con 0x7f4d740714e0 2020-07-16T20:30:34.027 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6401d5d0 con 0x7f4d740714e0 2020-07-16T20:30:34.027 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6401d930 con 0x7f4d740714e0 2020-07-16T20:30:34.029 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.006+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d741398f0 con 0x7f4d740714e0 2020-07-16T20:30:34.029 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.007+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74065cb0 con 0x7f4d740714e0 2020-07-16T20:30:34.029 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.007+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7f4d64025030 con 0x7f4d740714e0 2020-07-16T20:30:34.030 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.007+0000 7f4d697fa700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 0x7f4d4c052730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.030 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.007+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f4d64068180 con 0x7f4d740714e0 2020-07-16T20:30:34.030 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.007+0000 7f4d79a16700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 0x7f4d4c052730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.030 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.008+0000 7f4d79a16700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 0x7f4d4c052730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4d740705f0 tx=0x7f4d70007720).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.031 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.011+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f4d64041ae0 con 0x7f4d740714e0 2020-07-16T20:30:34.186 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.184+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2b74b7ca-1708-4096-8c95-c9eebefddf1e", "id": 7} v 0) v1 -- 0x7f4d74057490 con 0x7f4d740714e0 2020-07-16T20:30:34.198 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.192+0000 7f4d697fa700 1 -- 172.21.15.41:0/946489371 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b74b7ca-1708-4096-8c95-c9eebefddf1e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d64045100 con 0x7f4d740714e0 2020-07-16T20:30:34.198 INFO:teuthology.orchestra.run.smithi041.stdout:7 2020-07-16T20:30:34.200 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 msgr2=0x7f4d4c052730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.201 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 0x7f4d4c052730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4d740705f0 tx=0x7f4d70007720).stop 2020-07-16T20:30:34.201 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 msgr2=0x7f4d740a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.202 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 0x7f4d740a61a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64015000).stop 2020-07-16T20:30:34.202 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 shutdown_connections 2020-07-16T20:30:34.202 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f4d4c050270 0x7f4d4c052730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.203 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 --2- 172.21.15.41:0/946489371 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4d740714e0 0x7f4d740a61a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.203 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 >> 172.21.15.41:0/946489371 conn(0x7f4d7405b810 msgr2=0x7f4d7409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.203 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 shutdown_connections 2020-07-16T20:30:34.204 INFO:teuthology.orchestra.run.smithi041.stderr:2020-07-16T20:30:34.194+0000 7f4d7b479700 1 -- 172.21.15.41:0/946489371 wait complete. 2020-07-16T20:30:34.206 INFO:tasks.ceph.osd.0:Restarting daemon 2020-07-16T20:30:34.207 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-07-16T20:30:34.213 INFO:tasks.ceph.osd.0:Started 2020-07-16T20:30:34.214 INFO:tasks.ceph.osd.1:Restarting daemon 2020-07-16T20:30:34.214 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-07-16T20:30:34.217 INFO:tasks.ceph.osd.1:Started 2020-07-16T20:30:34.218 INFO:tasks.ceph.osd.2:Restarting daemon 2020-07-16T20:30:34.218 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-07-16T20:30:34.221 INFO:tasks.ceph.osd.2:Started 2020-07-16T20:30:34.221 INFO:tasks.ceph.osd.3:Restarting daemon 2020-07-16T20:30:34.222 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-07-16T20:30:34.225 INFO:tasks.ceph.osd.3:Started 2020-07-16T20:30:34.226 INFO:tasks.ceph.osd.4:Restarting daemon 2020-07-16T20:30:34.226 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-07-16T20:30:34.229 INFO:tasks.ceph.osd.4:Started 2020-07-16T20:30:34.230 INFO:tasks.ceph.osd.5:Restarting daemon 2020-07-16T20:30:34.231 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-07-16T20:30:34.234 INFO:tasks.ceph.osd.5:Started 2020-07-16T20:30:34.235 INFO:tasks.ceph.osd.6:Restarting daemon 2020-07-16T20:30:34.235 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-07-16T20:30:34.238 INFO:tasks.ceph.osd.6:Started 2020-07-16T20:30:34.239 INFO:tasks.ceph.osd.7:Restarting daemon 2020-07-16T20:30:34.240 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-07-16T20:30:34.244 INFO:tasks.ceph.osd.7:Started 2020-07-16T20:30:34.244 INFO:tasks.ceph:Waiting for OSDs to come up 2020-07-16T20:30:34.820 INFO:tasks.ceph.osd.0.smithi157.stderr:2020-07-16T20:30:34.817+0000 7f31198ceec0 -1 Falling back to public interface 2020-07-16T20:30:34.829 INFO:tasks.ceph.osd.2.smithi157.stderr:2020-07-16T20:30:34.826+0000 7fe3e90f2ec0 -1 Falling back to public interface 2020-07-16T20:30:34.832 INFO:tasks.ceph.osd.1.smithi157.stderr:2020-07-16T20:30:34.830+0000 7fbf6e09aec0 -1 Falling back to public interface 2020-07-16T20:30:34.841 INFO:tasks.ceph.osd.3.smithi157.stderr:2020-07-16T20:30:34.839+0000 7f4e92aadec0 -1 Falling back to public interface 2020-07-16T20:30:34.846 INFO:tasks.ceph.osd.4.smithi041.stderr:2020-07-16T20:30:34.844+0000 7fdecbf02ec0 -1 Falling back to public interface 2020-07-16T20:30:34.859 INFO:tasks.ceph.osd.6.smithi041.stderr:2020-07-16T20:30:34.858+0000 7f350e32bec0 -1 Falling back to public interface 2020-07-16T20:30:34.863 INFO:tasks.ceph.osd.5.smithi041.stderr:2020-07-16T20:30:34.861+0000 7fb317f0eec0 -1 Falling back to public interface 2020-07-16T20:30:34.863 INFO:tasks.ceph.osd.7.smithi041.stderr:2020-07-16T20:30:34.861+0000 7f7fa139dec0 -1 Falling back to public interface 2020-07-16T20:30:35.054 INFO:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-16T20:30:35.182 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.175+0000 7fafa54d5700 1 Processor -- start 2020-07-16T20:30:35.183 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.175+0000 7fafa54d5700 1 -- start start 2020-07-16T20:30:35.183 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa54d5700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fafa00a8390 0x7fafa00a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.184 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa54d5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafa00aa040 0x7fafa00678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.184 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa54d5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa009f730 con 0x7fafa0067da0 2020-07-16T20:30:35.184 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa54d5700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa00a96b0 con 0x7fafa00a8390 2020-07-16T20:30:35.185 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa54d5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa00aa4a0 con 0x7fafa00aa040 2020-07-16T20:30:35.185 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafa00aa040 0x7fafa00678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.185 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafa00aa040 0x7fafa00678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33212/0 (socket says 172.21.15.157:33212) 2020-07-16T20:30:35.186 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 -- 172.21.15.157:0/2394593348 learned_addr learned my addr 172.21.15.157:0/2394593348 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:35.186 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7fafa4cd4700 1 --2- 172.21.15.157:0/2394593348 >> v2:172.21.15.41:3300/0 conn(0x7fafa00a8390 0x7fafa00a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.187 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 -- 172.21.15.157:0/2394593348 >> v2:172.21.15.41:3300/0 conn(0x7fafa00a8390 msgr2=0x7fafa00a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.187 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 --2- 172.21.15.157:0/2394593348 >> v2:172.21.15.41:3300/0 conn(0x7fafa00a8390 0x7fafa00a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.187 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 -- 172.21.15.157:0/2394593348 >> v1:172.21.15.157:6789/0 conn(0x7fafa0067da0 legacy=0x7fafa0025270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.188 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9f7fe700 1 -- 172.21.15.157:0/2394593348 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055024888 0 0) 0x7fafa009f730 con 0x7fafa0067da0 2020-07-16T20:30:35.188 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 -- 172.21.15.157:0/2394593348 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00a8770 con 0x7fafa00aa040 2020-07-16T20:30:35.189 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9ffff700 1 --2- 172.21.15.157:0/2394593348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00aa040 0x7fafa00678b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7faf8c002f30 tx=0x7faf8c006e90).ready entity=mon.1 client_cookie=903ddc96d9c56826 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.189 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9f7fe700 1 -- 172.21.15.157:0/2394593348 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c009850 con 0x7fafa00aa040 2020-07-16T20:30:35.190 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9f7fe700 1 -- 172.21.15.157:0/2394593348 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0099b0 con 0x7fafa00aa040 2020-07-16T20:30:35.190 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.176+0000 7faf9f7fe700 1 -- 172.21.15.157:0/2394593348 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c009d10 con 0x7fafa00aa040 2020-07-16T20:30:35.191 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 -- 172.21.15.157:0/2394593348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00aa040 msgr2=0x7fafa00678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.191 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 --2- 172.21.15.157:0/2394593348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00aa040 0x7fafa00678b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7faf8c002f30 tx=0x7faf8c006e90).stop 2020-07-16T20:30:35.191 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 -- 172.21.15.157:0/2394593348 shutdown_connections 2020-07-16T20:30:35.192 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 --2- 172.21.15.157:0/2394593348 >> v2:172.21.15.41:3300/0 conn(0x7fafa00a8390 0x7fafa00a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.192 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 --2- 172.21.15.157:0/2394593348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00aa040 0x7fafa00678b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.193 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 -- 172.21.15.157:0/2394593348 >> 172.21.15.157:0/2394593348 conn(0x7fafa006abf0 msgr2=0x7fafa006b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.193 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 -- 172.21.15.157:0/2394593348 shutdown_connections 2020-07-16T20:30:35.194 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.177+0000 7fafa54d5700 1 -- 172.21.15.157:0/2394593348 wait complete. 2020-07-16T20:30:35.194 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.178+0000 7fafa54d5700 1 Processor -- start 2020-07-16T20:30:35.194 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 -- start start 2020-07-16T20:30:35.195 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fafa0067da0 0x7fafa014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.195 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafa00ad6f0 0x7fafa0124c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.196 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00a0b50 con 0x7fafa00a8390 2020-07-16T20:30:35.196 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa00acfb0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.197 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa54d5700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00ad250 con 0x7fafa0067da0 2020-07-16T20:30:35.197 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa6737700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafa00ad6f0 0x7fafa0124c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.198 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7faf9ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fafa00a8390 0x7fafa00a0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:49482/0 (socket says 172.21.15.157:49482) 2020-07-16T20:30:35.198 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7faf9ffff700 1 -- 172.21.15.157:0/884429926 learned_addr learned my addr 172.21.15.157:0/884429926 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:35.199 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.179+0000 7fafa4cd4700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fafa0067da0 0x7fafa014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.200 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa6737700 1 -- 172.21.15.157:0/884429926 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fafa0067da0 msgr2=0x7fafa014f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.200 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa6737700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fafa0067da0 0x7fafa014f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.201 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778015289 0 0) 0x7fafa00a0b50 con 0x7fafa00a8390 2020-07-16T20:30:35.201 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa6737700 1 -- 172.21.15.157:0/884429926 >> v1:172.21.15.41:6789/0 conn(0x7fafa00a8390 legacy=0x7fafa00a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.201 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa6737700 1 -- 172.21.15.157:0/884429926 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0150030 con 0x7fafa00ad6f0 2020-07-16T20:30:35.202 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa6737700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00ad6f0 0x7fafa0124c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faf98001210 tx=0x7faf98007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.202 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9800a7b0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.203 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98003030 con 0x7fafa00ad6f0 2020-07-16T20:30:35.203 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa00a3270 con 0x7fafa00ad6f0 2020-07-16T20:30:35.203 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9800ab00 con 0x7fafa00ad6f0 2020-07-16T20:30:35.204 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.180+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa00a3cf0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.206 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7faf98019030 con 0x7fafa00ad6f0 2020-07-16T20:30:35.206 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa01501c0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.206 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7faf83fff700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 0x7faf78052300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.207 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7faf98066350 con 0x7fafa00ad6f0 2020-07-16T20:30:35.207 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7fafa4cd4700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 0x7faf78052300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.207 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.182+0000 7fafa4cd4700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 0x7faf78052300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faf9400b000 tx=0x7faf94006dd0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.208 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.189+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7faf9803fcc0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.339 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.335+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa00ad420 con 0x7fafa00ad6f0 2020-07-16T20:30:35.340 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.336+0000 7faf83fff700 1 -- 172.21.15.157:0/884429926 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8277 (secure 0 0 0) 0x7faf980432e0 con 0x7fafa00ad6f0 2020-07-16T20:30:35.340 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 msgr2=0x7faf78052300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.341 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 0x7faf78052300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7faf9400b000 tx=0x7faf94006dd0).stop 2020-07-16T20:30:35.341 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00ad6f0 msgr2=0x7fafa0124c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.341 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00ad6f0 0x7fafa0124c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faf98001210 tx=0x7faf98007c70).stop 2020-07-16T20:30:35.342 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 shutdown_connections 2020-07-16T20:30:35.343 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7faf7804fe40 0x7faf78052300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.343 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafa00ad6f0 0x7fafa0124c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.343 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 --2- 172.21.15.157:0/884429926 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fafa0067da0 0x7fafa014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.344 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 >> 172.21.15.157:0/884429926 conn(0x7fafa006abf0 msgr2=0x7fafa00259c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.344 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 shutdown_connections 2020-07-16T20:30:35.344 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:35.337+0000 7fafa54d5700 1 -- 172.21.15.157:0/884429926 wait complete. 2020-07-16T20:30:35.345 INFO:teuthology.misc.health.smithi157.stdout: 2020-07-16T20:30:35.345 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":10,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:34.186654+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"5","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:35.349 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-07-16T20:30:35.888 INFO:tasks.ceph.osd.0.smithi157.stderr:2020-07-16T20:30:35.886+0000 7f31198ceec0 -1 osd.0 0 log_to_monitors {default=true} 2020-07-16T20:30:35.917 INFO:tasks.ceph.osd.2.smithi157.stderr:2020-07-16T20:30:35.913+0000 7fe3e90f2ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-07-16T20:30:35.917 INFO:tasks.ceph.osd.1.smithi157.stderr:2020-07-16T20:30:35.916+0000 7fbf6e09aec0 -1 osd.1 0 log_to_monitors {default=true} 2020-07-16T20:30:35.923 INFO:tasks.ceph.osd.4.smithi041.stderr:2020-07-16T20:30:35.922+0000 7fdecbf02ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-07-16T20:30:35.941 INFO:tasks.ceph.osd.3.smithi157.stderr:2020-07-16T20:30:35.938+0000 7f4e92aadec0 -1 osd.3 0 log_to_monitors {default=true} 2020-07-16T20:30:35.952 INFO:tasks.ceph.osd.5.smithi041.stderr:2020-07-16T20:30:35.950+0000 7fb317f0eec0 -1 osd.5 0 log_to_monitors {default=true} 2020-07-16T20:30:35.954 INFO:tasks.ceph.osd.6.smithi041.stderr:2020-07-16T20:30:35.952+0000 7f350e32bec0 -1 osd.6 0 log_to_monitors {default=true} 2020-07-16T20:30:35.966 INFO:tasks.ceph.osd.7.smithi041.stderr:2020-07-16T20:30:35.964+0000 7f7fa139dec0 -1 osd.7 0 log_to_monitors {default=true} 2020-07-16T20:30:37.577 INFO:tasks.ceph.osd.3.smithi157.stderr:2020-07-16T20:30:37.571+0000 7f4e892c3700 -1 osd.3 0 waiting for initial osdmap 2020-07-16T20:30:37.578 INFO:tasks.ceph.osd.0.smithi157.stderr:2020-07-16T20:30:37.573+0000 7f31118e7700 -1 osd.0 0 waiting for initial osdmap 2020-07-16T20:30:37.579 INFO:tasks.ceph.osd.2.smithi157.stderr:2020-07-16T20:30:37.573+0000 7fe3df908700 -1 osd.2 0 waiting for initial osdmap 2020-07-16T20:30:37.579 INFO:tasks.ceph.osd.1.smithi157.stderr:2020-07-16T20:30:37.573+0000 7fbf648b0700 -1 osd.1 0 waiting for initial osdmap 2020-07-16T20:30:37.579 INFO:tasks.ceph.osd.4.smithi041.stderr:2020-07-16T20:30:37.571+0000 7fdec2718700 -1 osd.4 0 waiting for initial osdmap 2020-07-16T20:30:37.580 INFO:tasks.ceph.osd.7.smithi041.stderr:2020-07-16T20:30:37.571+0000 7f7f97bb3700 -1 osd.7 0 waiting for initial osdmap 2020-07-16T20:30:37.580 INFO:tasks.ceph.osd.6.smithi041.stderr:2020-07-16T20:30:37.573+0000 7f3504b41700 -1 osd.6 0 waiting for initial osdmap 2020-07-16T20:30:37.581 INFO:tasks.ceph.osd.5.smithi041.stderr:2020-07-16T20:30:37.573+0000 7fb30e724700 -1 osd.5 0 waiting for initial osdmap 2020-07-16T20:30:42.157 INFO:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-16T20:30:42.271 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.266+0000 7f477481d700 1 Processor -- start 2020-07-16T20:30:42.272 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.266+0000 7f477481d700 1 -- start start 2020-07-16T20:30:42.272 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f477481d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4770060ea0 0x7f47700a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.272 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f477481d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700a5310 con 0x7f477014e3c0 2020-07-16T20:30:42.272 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f477481d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700a45a0 con 0x7f4770067e40 2020-07-16T20:30:42.272 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f477481d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47700a8070 con 0x7f4770060ea0 2020-07-16T20:30:42.273 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f476e59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4770067e40 0x7f47700a2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36134/0 (socket says 172.21.15.157:36134) 2020-07-16T20:30:42.273 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f476e59c700 1 -- 172.21.15.157:0/3390965408 learned_addr learned my addr 172.21.15.157:0/3390965408 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:42.273 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3390965408 >> v2:172.21.15.41:3300/0 conn(0x7f4770060ea0 0x7f47700a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.273 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876271869 0 0) 0x7f47700a45a0 con 0x7f4770067e40 2020-07-16T20:30:42.273 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.267+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4758003240 con 0x7f4770067e40 2020-07-16T20:30:42.282 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977952692 0 0) 0x7f47700a5310 con 0x7f477014e3c0 2020-07-16T20:30:42.282 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47700a45a0 con 0x7f477014e3c0 2020-07-16T20:30:42.282 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 808089866 0 0) 0x7f4758003240 con 0x7f4770067e40 2020-07-16T20:30:42.283 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 >> v2:172.21.15.41:3300/0 conn(0x7f4770060ea0 msgr2=0x7f47700a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.283 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 --2- 172.21.15.157:0/3390965408 >> v2:172.21.15.41:3300/0 conn(0x7f4770060ea0 0x7f47700a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.283 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 >> v1:172.21.15.41:6789/0 conn(0x7f477014e3c0 legacy=0x7f47701507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.283 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700a8310 con 0x7f4770067e40 2020-07-16T20:30:42.283 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f47640016d0 con 0x7f4770067e40 2020-07-16T20:30:42.284 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 >> v1:172.21.15.157:6789/0 conn(0x7f4770067e40 legacy=0x7f47700a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.284 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 0x7f4758003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.284 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47580044e0 0x7f4758004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.284 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4758004e50 0x7f475804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.285 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47700a8070 con 0x7f47580044e0 2020-07-16T20:30:42.285 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 0x7f4758003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.285 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475804fcc0 con 0x7f4758003910 2020-07-16T20:30:42.285 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475804fe30 con 0x7f4758004e50 2020-07-16T20:30:42.285 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476e59c700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47580044e0 0x7f4758004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.286 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476f59e700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4758004e50 0x7f475804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.289 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 -- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4758004e50 msgr2=0x7f475804f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.289 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f4758004e50 0x7f475804f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.289 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 -- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47580044e0 msgr2=0x7f4758004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.289 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47580044e0 0x7f4758004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.290 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 -- 172.21.15.157:0/3390965408 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758003240 con 0x7f4758003910 2020-07-16T20:30:42.291 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476f59e700 1 -- 172.21.15.157:0/3390965408 reap_dead start 2020-07-16T20:30:42.291 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 0x7f4758003d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4758004450 tx=0x7f4760008040).ready entity=mon.1 client_cookie=e432835f4fd752ab server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.291 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476000e970 con 0x7f4758003910 2020-07-16T20:30:42.291 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476000ead0 con 0x7f4758003910 2020-07-16T20:30:42.292 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f476dd9b700 1 -- 172.21.15.157:0/3390965408 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476000ee30 con 0x7f4758003910 2020-07-16T20:30:42.292 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 -- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 msgr2=0x7f4758003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.292 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 0x7f4758003d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4758004450 tx=0x7f4760008040).stop 2020-07-16T20:30:42.293 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 -- 172.21.15.157:0/3390965408 shutdown_connections 2020-07-16T20:30:42.293 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 --2- 172.21.15.157:0/3390965408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4758003910 0x7f4758003d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.293 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 -- 172.21.15.157:0/3390965408 >> 172.21.15.157:0/3390965408 conn(0x7f477005b840 msgr2=0x7f477005bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.294 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.268+0000 7f477481d700 1 -- 172.21.15.157:0/3390965408 shutdown_connections 2020-07-16T20:30:42.294 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.269+0000 7f477481d700 1 -- 172.21.15.157:0/3390965408 wait complete. 2020-07-16T20:30:42.298 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 Processor -- start 2020-07-16T20:30:42.298 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 -- start start 2020-07-16T20:30:42.299 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f4770134c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.299 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4770066790 con 0x7f4770124350 2020-07-16T20:30:42.299 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4770066d10 con 0x7f4770067450 2020-07-16T20:30:42.299 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.271+0000 7f477481d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4770066fb0 con 0x7f47700647d0 2020-07-16T20:30:42.300 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476e59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4770067450 0x7f4770066080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36144/0 (socket says 172.21.15.157:36144) 2020-07-16T20:30:42.300 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476e59c700 1 -- 172.21.15.157:0/3000542198 learned_addr learned my addr 172.21.15.157:0/3000542198 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:42.300 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355625264 0 0) 0x7f4770066d10 con 0x7f4770067450 2020-07-16T20:30:42.300 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f4770134c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.300 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474c003240 con 0x7f4770067450 2020-07-16T20:30:42.301 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2527998339 0 0) 0x7f474c003240 con 0x7f4770067450 2020-07-16T20:30:42.301 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4770066d10 con 0x7f4770067450 2020-07-16T20:30:42.301 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f47640014e0 con 0x7f4770067450 2020-07-16T20:30:42.301 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 msgr2=0x7f4770134c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.301 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f4770134c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.302 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 >> v1:172.21.15.157:6789/0 conn(0x7f4770067450 legacy=0x7f4770066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.302 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 >> v1:172.21.15.41:6789/0 conn(0x7f4770124350 legacy=0x7f4770124800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.302 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f474c003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.302 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474c003cf0 0x7f474c0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.302 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f474c0049d0 0x7f474c004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.303 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770066fb0 con 0x7f474c0049d0 2020-07-16T20:30:42.303 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0041f0 con 0x7f474c003cf0 2020-07-16T20:30:42.303 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c00b730 con 0x7f47700647d0 2020-07-16T20:30:42.303 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476e59c700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474c003cf0 0x7f474c0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.303 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f474c003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.304 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.272+0000 7f476f59e700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f474c0049d0 0x7f474c004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.304 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 -- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 msgr2=0x7f474c003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.304 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f47700647d0 0x7f474c003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.304 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 -- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f474c0049d0 msgr2=0x7f474c004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.304 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f474c0049d0 0x7f474c004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.305 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770064bb0 con 0x7f474c003cf0 2020-07-16T20:30:42.305 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770127ea0 con 0x7f474c003cf0 2020-07-16T20:30:42.305 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476f59e700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f474c0049d0 0x7f474c004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:42.305 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f476e59c700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474c003cf0 0x7f474c0044e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f47640014a0 tx=0x7f47700a84a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.305 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47701250d0 con 0x7f474c003cf0 2020-07-16T20:30:42.306 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47640114c0 con 0x7f474c003cf0 2020-07-16T20:30:42.306 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764011620 con 0x7f474c003cf0 2020-07-16T20:30:42.306 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4764011980 con 0x7f474c003cf0 2020-07-16T20:30:42.306 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.273+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770080d20 con 0x7f474c003cf0 2020-07-16T20:30:42.306 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.274+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f4764011ae0 con 0x7f474c003cf0 2020-07-16T20:30:42.307 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.274+0000 7f47567fc700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f474c05c630 0x7f474c05eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.307 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.274+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f47640678c0 con 0x7f474c003cf0 2020-07-16T20:30:42.307 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.274+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f474c05c630 0x7f474c05eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.307 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.274+0000 7f476ed9d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f474c05c630 0x7f474c05eaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f476001c000 tx=0x7f476001a000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.307 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.278+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f47640405c0 con 0x7f474c003cf0 2020-07-16T20:30:42.425 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.424+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4770128030 con 0x7f474c003cf0 2020-07-16T20:30:42.426 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.424+0000 7f47567fc700 1 -- 172.21.15.157:0/3000542198 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11856 (secure 0 0 0) 0x7f4764019030 con 0x7f474c003cf0 2020-07-16T20:30:42.426 INFO:teuthology.misc.health.smithi157.stdout: 2020-07-16T20:30:42.427 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":15,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:40.581869+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:42.428 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f474c05c630 msgr2=0x7f474c05eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.428 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f474c05c630 0x7f474c05eaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f476001c000 tx=0x7f476001a000).stop 2020-07-16T20:30:42.428 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474c003cf0 msgr2=0x7f474c0044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.428 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 --2- 172.21.15.157:0/3000542198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474c003cf0 0x7f474c0044e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f47640014a0 tx=0x7f47700a84a0).stop 2020-07-16T20:30:42.429 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f476f59e700 1 -- 172.21.15.157:0/3000542198 reap_dead start 2020-07-16T20:30:42.429 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f476f59e700 1 -- 172.21.15.157:0/3000542198 reap_dead start 2020-07-16T20:30:42.429 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 shutdown_connections 2020-07-16T20:30:42.429 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 >> 172.21.15.157:0/3000542198 conn(0x7f477005b840 msgr2=0x7f477009f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.430 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 shutdown_connections 2020-07-16T20:30:42.430 INFO:teuthology.misc.health.smithi157.stderr:2020-07-16T20:30:42.426+0000 7f477481d700 1 -- 172.21.15.157:0/3000542198 wait complete. 2020-07-16T20:30:42.437 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-07-16T20:30:42.437 INFO:tasks.ceph:Creating RBD pool 2020-07-16T20:30:42.437 INFO:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd pool create rbd 8 2020-07-16T20:30:42.549 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.545+0000 7fb7c4250700 1 Processor -- start 2020-07-16T20:30:42.550 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.545+0000 7fb7c4250700 1 -- start start 2020-07-16T20:30:42.550 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb7bc0a5810 0x7fb7bc067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0807a0 0x7fb7bc0a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0a8720 con 0x7fb7bc0807a0 2020-07-16T20:30:42.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0a2d80 con 0x7fb7bc0a8290 2020-07-16T20:30:42.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c4250700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc080c20 con 0x7fb7bc0a5810 2020-07-16T20:30:42.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33472/0 (socket says 172.21.15.157:33472) 2020-07-16T20:30:42.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 -- 172.21.15.157:0/1811045536 learned_addr learned my addr 172.21.15.157:0/1811045536 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:42.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c27ed700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb7bc0a5810 0x7fb7bc067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.554 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/1811045536 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0807a0 0x7fb7bc0a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.554 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 -- 172.21.15.157:0/1811045536 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb7bc0a5810 msgr2=0x7fb7bc067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.554 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb7bc0a5810 0x7fb7bc067c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 -- 172.21.15.157:0/1811045536 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0807a0 msgr2=0x7fb7bc0a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 --2- 172.21.15.157:0/1811045536 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0807a0 0x7fb7bc0a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 -- 172.21.15.157:0/1811045536 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0a3660 con 0x7fb7bc0a8290 2020-07-16T20:30:42.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.546+0000 7fb7c2fee700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb7b40032b0 tx=0x7fb7b4009270).ready entity=mon.1 client_cookie=2f5b103849a04db5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c17eb700 1 -- 172.21.15.157:0/1811045536 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b4009e60 con 0x7fb7bc0a8290 2020-07-16T20:30:42.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c17eb700 1 -- 172.21.15.157:0/1811045536 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b400bc00 con 0x7fb7bc0a8290 2020-07-16T20:30:42.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c17eb700 1 -- 172.21.15.157:0/1811045536 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b400bd70 con 0x7fb7bc0a8290 2020-07-16T20:30:42.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 -- 172.21.15.157:0/1811045536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7bc0a8290 msgr2=0x7fb7bc0a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb7b40032b0 tx=0x7fb7b4009270).stop 2020-07-16T20:30:42.558 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 -- 172.21.15.157:0/1811045536 shutdown_connections 2020-07-16T20:30:42.558 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb7bc0a5810 0x7fb7bc067c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.559 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 --2- 172.21.15.157:0/1811045536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7bc0a8290 0x7fb7bc0a5fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 --2- 172.21.15.157:0/1811045536 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0807a0 0x7fb7bc0a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 -- 172.21.15.157:0/1811045536 >> 172.21.15.157:0/1811045536 conn(0x7fb7bc05b810 msgr2=0x7fb7bc05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 -- 172.21.15.157:0/1811045536 shutdown_connections 2020-07-16T20:30:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.547+0000 7fb7c4250700 1 -- 172.21.15.157:0/1811045536 wait complete. 2020-07-16T20:30:42.584 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 Processor -- start 2020-07-16T20:30:42.584 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 -- start start 2020-07-16T20:30:42.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0648e0 0x7fb7bc126610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc127d20 con 0x7fb7bc0807a0 2020-07-16T20:30:42.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc125f10 con 0x7fb7bc126b00 2020-07-16T20:30:42.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c4250700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc064d70 con 0x7fb7bc0648e0 2020-07-16T20:30:42.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c2fee700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb7bc126b00 0x7fb7bc062880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36166/0 (socket says 172.21.15.157:36166) 2020-07-16T20:30:42.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.549+0000 7fb7c2fee700 1 -- 172.21.15.157:0/2540695273 learned_addr learned my addr 172.21.15.157:0/2540695273 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:42.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/2540695273 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0648e0 0x7fb7bc126610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792419238 0 0) 0x7fb7bc125f10 con 0x7fb7bc126b00 2020-07-16T20:30:42.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c003240 con 0x7fb7bc126b00 2020-07-16T20:30:42.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3041319013 0 0) 0x7fb79c003240 con 0x7fb7bc126b00 2020-07-16T20:30:42.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb7bc125f10 con 0x7fb7bc126b00 2020-07-16T20:30:42.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fb7b4009e60 con 0x7fb7bc126b00 2020-07-16T20:30:42.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0648e0 msgr2=0x7fb7bc126610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 --2- 172.21.15.157:0/2540695273 >> v2:172.21.15.41:3300/0 conn(0x7fb7bc0648e0 0x7fb7bc126610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 >> v1:172.21.15.157:6789/0 conn(0x7fb7bc126b00 legacy=0x7fb7bc062880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 >> v1:172.21.15.41:6789/0 conn(0x7fb7bc0807a0 legacy=0x7fb7bc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb79c003800 0x7fb79c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 0x7fb79c004940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb79c004e30 0x7fb79c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc064d70 con 0x7fb79c004e30 2020-07-16T20:30:42.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c00bc20 con 0x7fb79c0044e0 2020-07-16T20:30:42.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c00bd60 con 0x7fb79c003800 2020-07-16T20:30:42.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 0x7fb79c004940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c27ed700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb79c003800 0x7fb79c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c2fee700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb79c004e30 0x7fb79c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 -- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb79c003800 msgr2=0x7fb79c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb79c003800 0x7fb79c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 -- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb79c004e30 msgr2=0x7fb79c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb79c004e30 0x7fb79c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc126170 con 0x7fb79c0044e0 2020-07-16T20:30:42.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c2fee700 1 -- 172.21.15.157:0/2540695273 reap_dead start 2020-07-16T20:30:42.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c27ed700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fb79c003800 0x7fb79c003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:42.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc126ee0 con 0x7fb79c0044e0 2020-07-16T20:30:42.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c1fec700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 0x7fb79c004940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb79c0054b0 tx=0x7fb7ac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac010e70 con 0x7fb79c0044e0 2020-07-16T20:30:42.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.550+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc126850 con 0x7fb79c0044e0 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.551+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00ea50 con 0x7fb79c0044e0 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.551+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac00edb0 con 0x7fb79c0044e0 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.551+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc126300 con 0x7fb79c0044e0 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.551+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb7ac014470 con 0x7fb79c0044e0 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.552+0000 7fb7b1ffb700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 0x7fb79c056490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.552+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fb7ac0680c0 con 0x7fb79c0044e0 2020-07-16T20:30:42.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.552+0000 7fb7c27ed700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 0x7fb79c056490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.552+0000 7fb7c27ed700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 0x7fb79c056490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb7b8002000 tx=0x7fb7b8008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.556+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb7ac040d60 con 0x7fb79c0044e0 2020-07-16T20:30:42.714 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:42.713+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb7bc057490 con 0x7fb79c0044e0 2020-07-16T20:30:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.684+0000 7fb7b1ffb700 1 -- 172.21.15.157:0/2540695273 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb7ac018070 con 0x7fb79c0044e0 2020-07-16T20:30:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 msgr2=0x7fb79c056490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 0x7fb79c056490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb7b8002000 tx=0x7fb7b8008040).stop 2020-07-16T20:30:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 msgr2=0x7fb79c004940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 0x7fb79c004940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb79c0054b0 tx=0x7fb7ac008040).stop 2020-07-16T20:30:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 shutdown_connections 2020-07-16T20:30:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fb79c053fd0 0x7fb79c056490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 --2- 172.21.15.157:0/2540695273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c0044e0 0x7fb79c004940 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0x7fb79c0054b0 tx=0x7fb7ac008040).stop 2020-07-16T20:30:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 >> 172.21.15.157:0/2540695273 conn(0x7fb7bc05b810 msgr2=0x7fb7bc0a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 shutdown_connections 2020-07-16T20:30:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.687+0000 7fb7c4250700 1 -- 172.21.15.157:0/2540695273 wait complete. 2020-07-16T20:30:43.693 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'rbd' created 2020-07-16T20:30:43.700 INFO:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-07-16T20:30:43.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.809+0000 7f6a1f1d7700 1 Processor -- start 2020-07-16T20:30:43.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.809+0000 7f6a1f1d7700 1 -- start start 2020-07-16T20:30:43.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1f1d7700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a180a5810 0x7f6a18067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1f1d7700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180a2d80 con 0x7f6a1814e3f0 2020-07-16T20:30:43.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1f1d7700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a18080c20 con 0x7f6a180807a0 2020-07-16T20:30:43.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1f1d7700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180a3660 con 0x7f6a180a5810 2020-07-16T20:30:43.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1cf73700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6a180807a0 0x7f6a180a7da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36182/0 (socket says 172.21.15.157:36182) 2020-07-16T20:30:43.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1cf73700 1 -- 172.21.15.157:0/1713179295 learned_addr learned my addr 172.21.15.157:0/1713179295 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:43.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421076439 0 0) 0x7f6a080010d0 con 0x7f6a180807a0 2020-07-16T20:30:43.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a04003240 con 0x7f6a180807a0 2020-07-16T20:30:43.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a180a5810 0x7f6a18067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3115004995 0 0) 0x7f6a04003240 con 0x7f6a180807a0 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a180a5810 msgr2=0x7f6a18067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a180a5810 0x7f6a18067c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 >> v1:172.21.15.41:6789/0 conn(0x7f6a1814e3f0 legacy=0x7f6a181507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180a38c0 con 0x7f6a180807a0 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f6a08001860 con 0x7f6a180807a0 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 >> v1:172.21.15.157:6789/0 conn(0x7f6a180807a0 legacy=0x7f6a180a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a04003760 0x7f6a04003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a040044e0 0x7f6a04004920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a04004e10 0x7f6a0400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180a3660 con 0x7f6a04004e10 2020-07-16T20:30:43.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04005380 con 0x7f6a04003760 2020-07-16T20:30:43.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a04003760 0x7f6a04003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040041f0 con 0x7f6a040044e0 2020-07-16T20:30:43.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1cf73700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a040044e0 0x7f6a04004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.810+0000 7f6a1df75700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a04004e10 0x7f6a0400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 -- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a040044e0 msgr2=0x7f6a04004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a040044e0 0x7f6a04004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 -- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a04004e10 msgr2=0x7f6a0400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a04004e10 0x7f6a0400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 -- 172.21.15.157:0/1713179295 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04003240 con 0x7f6a04003760 2020-07-16T20:30:43.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a04003760 0x7f6a04003b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6a1400a000 tx=0x7f6a14008040).ready entity=mon.1 client_cookie=e9cb9b1345394e71 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400ba60 con 0x7f6a04003760 2020-07-16T20:30:43.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400bbc0 con 0x7f6a04003760 2020-07-16T20:30:43.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a0ffff700 1 -- 172.21.15.157:0/1713179295 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400de60 con 0x7f6a04003760 2020-07-16T20:30:43.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1713179295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a04003760 msgr2=0x7f6a04003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1713179295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a04003760 0x7f6a04003b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6a1400a000 tx=0x7f6a14008040).stop 2020-07-16T20:30:43.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1df75700 1 -- 172.21.15.157:0/1713179295 reap_dead start 2020-07-16T20:30:43.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1713179295 shutdown_connections 2020-07-16T20:30:43.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1713179295 >> 172.21.15.157:0/1713179295 conn(0x7f6a1805b810 msgr2=0x7f6a1805bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1713179295 shutdown_connections 2020-07-16T20:30:43.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.811+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1713179295 wait complete. 2020-07-16T20:30:43.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 Processor -- start 2020-07-16T20:30:43.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 -- start start 2020-07-16T20:30:43.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 0x7f6a18075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a18074700 con 0x7f6a18067360 2020-07-16T20:30:43.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180773f0 con 0x7f6a181379c0 2020-07-16T20:30:43.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.813+0000 7f6a1f1d7700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18077610 con 0x7f6a1807f2b0 2020-07-16T20:30:43.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1df75700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 0x7f6a18075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1df75700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:58748/0 (socket says 172.21.15.157:58748) 2020-07-16T20:30:43.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1df75700 1 -- 172.21.15.157:0/1130843308 learned_addr learned my addr 172.21.15.157:0/1130843308 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:43.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 -- 172.21.15.157:0/1130843308 >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 msgr2=0x7f6a1814d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 --2- 172.21.15.157:0/1130843308 >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 -- 172.21.15.157:0/1130843308 >> v1:172.21.15.41:6789/0 conn(0x7f6a18067360 legacy=0x7f6a1807eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 -- 172.21.15.157:0/1130843308 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18075020 con 0x7f6a1807f2b0 2020-07-16T20:30:43.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724426604 0 0) 0x7f6a18074700 con 0x7f6a18067360 2020-07-16T20:30:43.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1df75700 1 --2- 172.21.15.157:0/1130843308 >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:43.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1cf73700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 0x7f6a18075760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6a0800d000 tx=0x7f6a180a3a50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a0800fa30 con 0x7f6a1807f2b0 2020-07-16T20:30:43.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800fb90 con 0x7f6a1807f2b0 2020-07-16T20:30:43.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a08012350 con 0x7f6a1807f2b0 2020-07-16T20:30:43.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180752c0 con 0x7f6a1807f2b0 2020-07-16T20:30:43.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.814+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18137e10 con 0x7f6a1807f2b0 2020-07-16T20:30:43.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.815+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a18075450 con 0x7f6a1807f2b0 2020-07-16T20:30:43.840 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.815+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6a0801b030 con 0x7f6a1807f2b0 2020-07-16T20:30:43.840 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.816+0000 7f6a0cff9700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 0x7f69f0052390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.840 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.816+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f6a08067160 con 0x7f6a1807f2b0 2020-07-16T20:30:43.841 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.816+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 0x7f69f0052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.841 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.816+0000 7f6a1d774700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 0x7f69f0052390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a14002f30 tx=0x7f6a14008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.820+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6a0803fcb0 con 0x7f6a1807f2b0 2020-07-16T20:30:43.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:43.968+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a18080c20 con 0x7f6a1807f2b0 2020-07-16T20:30:44.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.689+0000 7f6a0cff9700 1 -- 172.21.15.157:0/1130843308 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6a18080c20 con 0x7f6a1807f2b0 2020-07-16T20:30:44.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 msgr2=0x7f69f0052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 0x7f69f0052390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a14002f30 tx=0x7f6a14008040).stop 2020-07-16T20:30:44.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 msgr2=0x7f6a18075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 0x7f6a18075760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6a0800d000 tx=0x7f6a180a3a50).stop 2020-07-16T20:30:44.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 shutdown_connections 2020-07-16T20:30:44.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69f004fed0 0x7f69f0052390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1130843308 >> v2:172.21.15.41:3300/0 conn(0x7f6a181379c0 0x7f6a1814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 --2- 172.21.15.157:0/1130843308 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6a1807f2b0 0x7f6a18075760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 >> 172.21.15.157:0/1130843308 conn(0x7f6a1805b810 msgr2=0x7f6a180a0740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 shutdown_connections 2020-07-16T20:30:44.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.691+0000 7f6a1f1d7700 1 -- 172.21.15.157:0/1130843308 wait complete. 2020-07-16T20:30:44.697 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rbd' on pool 'rbd' 2020-07-16T20:30:44.706 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-07-16T20:30:44.707 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:44.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.815+0000 7fe07e01e700 1 Processor -- start 2020-07-16T20:30:44.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.815+0000 7fe07e01e700 1 -- start start 2020-07-16T20:30:44.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe07e01e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe0780a86c0 0x7fe0780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe07e01e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe078133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe07e01e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780a5450 con 0x7fe0780a48e0 2020-07-16T20:30:44.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe07e01e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780a7880 con 0x7fe0780a86c0 2020-07-16T20:30:44.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe07e01e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780a56b0 con 0x7fe078132c80 2020-07-16T20:30:44.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe0777fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe0780a48e0 0x7fe0780a7fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36202/0 (socket says 172.21.15.157:36202) 2020-07-16T20:30:44.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe0777fe700 1 -- 172.21.15.157:0/2304820602 learned_addr learned my addr 172.21.15.157:0/2304820602 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:44.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859610823 0 0) 0x7fe0780a5450 con 0x7fe0780a48e0 2020-07-16T20:30:44.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe077fff700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe078133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003240 con 0x7fe0780a48e0 2020-07-16T20:30:44.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.816+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2304820602 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a86c0 0x7fe0780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1624395720 0 0) 0x7fe064003240 con 0x7fe0780a48e0 2020-07-16T20:30:44.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 msgr2=0x7fe078133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe078133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a86c0 msgr2=0x7fe0780a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 --2- 172.21.15.157:0/2304820602 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a86c0 0x7fe0780a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780a5950 con 0x7fe0780a48e0 2020-07-16T20:30:44.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fe0680016d0 con 0x7fe0780a48e0 2020-07-16T20:30:44.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 >> v1:172.21.15.157:6789/0 conn(0x7fe0780a48e0 legacy=0x7fe0780a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe064003730 0x7fe064003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0640044e0 0x7fe064004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe064004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780a7880 con 0x7fe064003730 2020-07-16T20:30:44.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780a56b0 con 0x7fe0640044e0 2020-07-16T20:30:44.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe064004270 con 0x7fe078132c80 2020-07-16T20:30:44.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0640044e0 0x7fe064004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0777fe700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe064003730 0x7fe064003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe077fff700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe064004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 -- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 msgr2=0x7fe064004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe078132c80 0x7fe064004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 -- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe064003730 msgr2=0x7fe064003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe064003730 0x7fe064003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 -- 172.21.15.157:0/2304820602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064003240 con 0x7fe0640044e0 2020-07-16T20:30:44.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0640044e0 0x7fe064004960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe06c00c000 tx=0x7fe06c008040).ready entity=mon.1 client_cookie=34e97b51459913a2 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c00eb60 con 0x7fe0640044e0 2020-07-16T20:30:44.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00ecc0 con 0x7fe0640044e0 2020-07-16T20:30:44.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe0767fc700 1 -- 172.21.15.157:0/2304820602 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c0125e0 con 0x7fe0640044e0 2020-07-16T20:30:44.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 -- 172.21.15.157:0/2304820602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0640044e0 msgr2=0x7fe064004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2304820602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0640044e0 0x7fe064004960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe06c00c000 tx=0x7fe06c008040).stop 2020-07-16T20:30:44.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe077fff700 1 -- 172.21.15.157:0/2304820602 reap_dead start 2020-07-16T20:30:44.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 -- 172.21.15.157:0/2304820602 shutdown_connections 2020-07-16T20:30:44.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 -- 172.21.15.157:0/2304820602 >> 172.21.15.157:0/2304820602 conn(0x7fe078061820 msgr2=0x7fe07809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 -- 172.21.15.157:0/2304820602 shutdown_connections 2020-07-16T20:30:44.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.817+0000 7fe07e01e700 1 -- 172.21.15.157:0/2304820602 wait complete. 2020-07-16T20:30:44.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 Processor -- start 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 -- start start 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe0780a9830 0x7fe0781494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe0781325a0 0x7fe078131f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0781317c0 con 0x7fe0781356b0 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe078131a60 con 0x7fe0780a9830 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe07e01e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe078135a90 con 0x7fe0781325a0 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.819+0000 7fe0777fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe0781356b0 0x7fe07812c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36214/0 (socket says 172.21.15.157:36214) 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0777fe700 1 -- 172.21.15.157:0/2811366368 learned_addr learned my addr 172.21.15.157:0/2811366368 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 --2- 172.21.15.157:0/2811366368 >> v2:172.21.15.157:3300/0 conn(0x7fe0781325a0 0x7fe078131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe076ffd700 1 --2- 172.21.15.157:0/2811366368 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a9830 0x7fe0781494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515928061 0 0) 0x7fe0781317c0 con 0x7fe0781356b0 2020-07-16T20:30:44.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe050003240 con 0x7fe0781356b0 2020-07-16T20:30:44.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 -- 172.21.15.157:0/2811366368 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a9830 msgr2=0x7fe0781494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 --2- 172.21.15.157:0/2811366368 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a9830 0x7fe0781494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 -- 172.21.15.157:0/2811366368 >> v1:172.21.15.157:6789/0 conn(0x7fe0781356b0 legacy=0x7fe07812c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 -- 172.21.15.157:0/2811366368 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780a9d40 con 0x7fe0781325a0 2020-07-16T20:30:44.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe077fff700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781325a0 0x7fe078131f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe07000b000 tx=0x7fe0700091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000f9e0 con 0x7fe0781325a0 2020-07-16T20:30:44.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000fb40 con 0x7fe0781325a0 2020-07-16T20:30:44.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07812cf10 con 0x7fe0781325a0 2020-07-16T20:30:44.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000fcb0 con 0x7fe0781325a0 2020-07-16T20:30:44.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.820+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07812d380 con 0x7fe0781325a0 2020-07-16T20:30:44.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.821+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fe070014440 con 0x7fe0781325a0 2020-07-16T20:30:44.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.821+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07812fcc0 con 0x7fe0781325a0 2020-07-16T20:30:44.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.821+0000 7fe0577fe700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 0x7fe050052840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.821+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe070067c30 con 0x7fe0781325a0 2020-07-16T20:30:44.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.821+0000 7fe0777fe700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 0x7fe050052840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.822+0000 7fe0777fe700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 0x7fe050052840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe06800d000 tx=0x7fe0780a5ae0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.825+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fe0700407f0 con 0x7fe0781325a0 2020-07-16T20:30:44.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.977+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe078057490 con 0x7fe0781325a0 2020-07-16T20:30:44.979 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.977+0000 7fe0577fe700 1 -- 172.21.15.157:0/2811366368 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13242 (secure 0 0 0) 0x7fe070018020 con 0x7fe0781325a0 2020-07-16T20:30:44.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:44.980 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:44.683319+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:44.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 msgr2=0x7fe050052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 0x7fe050052840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe06800d000 tx=0x7fe0780a5ae0).stop 2020-07-16T20:30:44.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781325a0 msgr2=0x7fe078131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781325a0 0x7fe078131f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe07000b000 tx=0x7fe0700091d0).stop 2020-07-16T20:30:44.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 shutdown_connections 2020-07-16T20:30:44.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe050050380 0x7fe050052840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2811366368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781325a0 0x7fe078131f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 --2- 172.21.15.157:0/2811366368 >> v2:172.21.15.41:3300/0 conn(0x7fe0780a9830 0x7fe0781494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 >> 172.21.15.157:0/2811366368 conn(0x7fe078061820 msgr2=0x7fe0780ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 shutdown_connections 2020-07-16T20:30:44.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:44.979+0000 7fe07e01e700 1 -- 172.21.15.157:0/2811366368 wait complete. 2020-07-16T20:30:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:32.588806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:42.750526+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-07-16T20:30:44.992 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:45.101 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.100+0000 7f6b4493f700 1 Processor -- start 2020-07-16T20:30:45.102 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.100+0000 7f6b4493f700 1 -- start start 2020-07-16T20:30:45.107 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b4493f700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.107 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b4493f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6b40139ac0 0x7f6b40139f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.107 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b4493f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b40060530 con 0x7f6b4009e7e0 2020-07-16T20:30:45.107 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b4493f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b40139600 con 0x7f6b40139ac0 2020-07-16T20:30:45.108 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b4493f700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40060760 con 0x7f6b400a9570 2020-07-16T20:30:45.108 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3dd9b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.108 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6b40139ac0 0x7f6b40139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.109 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3dd9b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:58876/0 (socket says 172.21.15.157:58876) 2020-07-16T20:30:45.109 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6b40139ac0 0x7f6b40139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:58776/0 (socket says 172.21.15.157:58776) 2020-07-16T20:30:45.110 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3dd9b700 1 -- 172.21.15.157:0/82923895 learned_addr learned my addr 172.21.15.157:0/82923895 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:45.110 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3e59c700 1 --1- 172.21.15.157:0/82923895 >> v1:172.21.15.41:6789/0 conn(0x7f6b4009e7e0 0x7f6b400ae0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:49798/0 (socket says 172.21.15.157:49798) 2020-07-16T20:30:45.110 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 -- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 msgr2=0x7f6b400a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.111 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.111 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 -- 172.21.15.157:0/82923895 >> v1:172.21.15.41:6789/0 conn(0x7f6b4009e7e0 legacy=0x7f6b400ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.111 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 -- 172.21.15.157:0/82923895 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40060a00 con 0x7f6b40139ac0 2020-07-16T20:30:45.112 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3dd9b700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:45.112 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.101+0000 7f6b3ed9d700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6b40139ac0 0x7f6b40139f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6b30002f30 tx=0x7f6b30006dd0).ready entity=mon.0 client_cookie=1e799e328b1c34a8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.112 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b3d59a700 1 -- 172.21.15.157:0/82923895 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b30009760 con 0x7f6b40139ac0 2020-07-16T20:30:45.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b3d59a700 1 -- 172.21.15.157:0/82923895 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300098c0 con 0x7f6b40139ac0 2020-07-16T20:30:45.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b3d59a700 1 -- 172.21.15.157:0/82923895 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b30009c20 con 0x7f6b40139ac0 2020-07-16T20:30:45.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 -- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6b40139ac0 msgr2=0x7f6b40139f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6b40139ac0 0x7f6b40139f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6b30002f30 tx=0x7f6b30006dd0).stop 2020-07-16T20:30:45.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 -- 172.21.15.157:0/82923895 shutdown_connections 2020-07-16T20:30:45.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6b40139ac0 0x7f6b40139f50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.115 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 --2- 172.21.15.157:0/82923895 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b400a9570 0x7f6b400a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.115 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 -- 172.21.15.157:0/82923895 >> 172.21.15.157:0/82923895 conn(0x7f6b40063990 msgr2=0x7f6b400ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.115 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 -- 172.21.15.157:0/82923895 shutdown_connections 2020-07-16T20:30:45.116 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.102+0000 7f6b4493f700 1 -- 172.21.15.157:0/82923895 wait complete. 2020-07-16T20:30:45.116 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.103+0000 7f6b4493f700 1 Processor -- start 2020-07-16T20:30:45.116 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.103+0000 7f6b4493f700 1 -- start start 2020-07-16T20:30:45.116 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b400a9570 0x7f6b400a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.117 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b40067ff0 0x7f6b400a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.117 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b40065050 con 0x7f6b4009e7e0 2020-07-16T20:30:45.117 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400652f0 con 0x7f6b400a9570 2020-07-16T20:30:45.117 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40065590 con 0x7f6b40067ff0 2020-07-16T20:30:45.118 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b400a9570 0x7f6b400a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.118 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b400a9570 0x7f6b400a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33542/0 (socket says 172.21.15.157:33542) 2020-07-16T20:30:45.118 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 -- 172.21.15.157:0/4054301949 learned_addr learned my addr 172.21.15.157:0/4054301949 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:45.119 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3ed9d700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b40067ff0 0x7f6b400a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.119 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 -- 172.21.15.157:0/4054301949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b40067ff0 msgr2=0x7f6b400a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.119 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b40067ff0 0x7f6b400a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.120 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 -- 172.21.15.157:0/4054301949 >> v1:172.21.15.41:6789/0 conn(0x7f6b4009e7e0 legacy=0x7f6b40148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.120 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 -- 172.21.15.157:0/4054301949 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40065830 con 0x7f6b400a9570 2020-07-16T20:30:45.120 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b3dd9b700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b400a9570 0x7f6b400a7130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6b2800c000 tx=0x7f6b28006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.121 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b2800cbb0 con 0x7f6b400a9570 2020-07-16T20:30:45.121 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800cd10 con 0x7f6b400a9570 2020-07-16T20:30:45.121 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40065cd0 con 0x7f6b400a9570 2020-07-16T20:30:45.122 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.104+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b280125e0 con 0x7f6b400a9570 2020-07-16T20:30:45.122 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.105+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b40066170 con 0x7f6b400a9570 2020-07-16T20:30:45.122 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.105+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400659c0 con 0x7f6b400a9570 2020-07-16T20:30:45.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.105+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6b28022070 con 0x7f6b400a9570 2020-07-16T20:30:45.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.106+0000 7f6b367fc700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 0x7f6b1c052450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.106+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6b280681d0 con 0x7f6b400a9570 2020-07-16T20:30:45.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.106+0000 7f6b3e59c700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 0x7f6b1c052450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.106+0000 7f6b3e59c700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 0x7f6b1c052450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b400643c0 tx=0x7f6b38007b60).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.126 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.109+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6b28040d70 con 0x7f6b400a9570 2020-07-16T20:30:45.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.256+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6b40057490 con 0x7f6b400a9570 2020-07-16T20:30:45.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.256+0000 7f6b367fc700 1 -- 172.21.15.157:0/4054301949 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6b28044390 con 0x7f6b400a9570 2020-07-16T20:30:45.259 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2020-07-16T20:30:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 msgr2=0x7f6b1c052450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 0x7f6b1c052450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b400643c0 tx=0x7f6b38007b60).stop 2020-07-16T20:30:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b400a9570 msgr2=0x7f6b400a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b400a9570 0x7f6b400a7130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6b2800c000 tx=0x7f6b28006e90).stop 2020-07-16T20:30:45.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 shutdown_connections 2020-07-16T20:30:45.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6b1c04ff90 0x7f6b1c052450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6b40067ff0 0x7f6b400a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 --2- 172.21.15.157:0/4054301949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b400a9570 0x7f6b400a7130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.262 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 >> 172.21.15.157:0/4054301949 conn(0x7f6b40063990 msgr2=0x7f6b40138760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.262 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 shutdown_connections 2020-07-16T20:30:45.262 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.258+0000 7f6b4493f700 1 -- 172.21.15.157:0/4054301949 wait complete. 2020-07-16T20:30:45.274 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:45.383 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.381+0000 7f06f0fbb700 1 Processor -- start 2020-07-16T20:30:45.383 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.381+0000 7f06f0fbb700 1 -- start start 2020-07-16T20:30:45.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec0a7470 0x7f06ec133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06ec133860 0x7f06ec0a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a8800 0x7f06ec139840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.386 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec133cc0 con 0x7f06ec133860 2020-07-16T20:30:45.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0a4710 con 0x7f06ec0a8800 2020-07-16T20:30:45.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06f0fbb700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0a5c00 con 0x7f06ec0a7470 2020-07-16T20:30:45.387 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06ead9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a8800 0x7f06ec139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06ead9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a8800 0x7f06ec139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33548/0 (socket says 172.21.15.157:33548) 2020-07-16T20:30:45.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06ead9d700 1 -- 172.21.15.157:0/3770625241 learned_addr learned my addr 172.21.15.157:0/3770625241 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:45.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06ea59c700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec0a7470 0x7f06ec133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.388 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.382+0000 7f06e9d9b700 1 --2- 172.21.15.157:0/3770625241 >> v2:172.21.15.41:3300/0 conn(0x7f06ec133860 0x7f06ec0a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 -- 172.21.15.157:0/3770625241 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec0a7470 msgr2=0x7f06ec133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec0a7470 0x7f06ec133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.389 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 -- 172.21.15.157:0/3770625241 >> v2:172.21.15.41:3300/0 conn(0x7f06ec133860 msgr2=0x7f06ec0a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.390 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 --2- 172.21.15.157:0/3770625241 >> v2:172.21.15.41:3300/0 conn(0x7f06ec133860 0x7f06ec0a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.390 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 -- 172.21.15.157:0/3770625241 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0a9110 con 0x7f06ec0a8800 2020-07-16T20:30:45.391 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06ead9d700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a8800 0x7f06ec139840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f06e40032b0 tx=0x7f06e4009270).ready entity=mon.1 client_cookie=76f7ac1ea0ad1e97 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.391 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06e959a700 1 -- 172.21.15.157:0/3770625241 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e4009e60 con 0x7f06ec0a8800 2020-07-16T20:30:45.391 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06e959a700 1 -- 172.21.15.157:0/3770625241 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400bb50 con 0x7f06ec0a8800 2020-07-16T20:30:45.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06e959a700 1 -- 172.21.15.157:0/3770625241 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e400bcc0 con 0x7f06ec0a8800 2020-07-16T20:30:45.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 -- 172.21.15.157:0/3770625241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a8800 msgr2=0x7f06ec139840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.392 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a8800 0x7f06ec139840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f06e40032b0 tx=0x7f06e4009270).stop 2020-07-16T20:30:45.393 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 -- 172.21.15.157:0/3770625241 shutdown_connections 2020-07-16T20:30:45.393 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec0a7470 0x7f06ec133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.394 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/3770625241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a8800 0x7f06ec139840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.394 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/3770625241 >> v2:172.21.15.41:3300/0 conn(0x7f06ec133860 0x7f06ec0a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.394 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 -- 172.21.15.157:0/3770625241 >> 172.21.15.157:0/3770625241 conn(0x7f06ec09e7e0 msgr2=0x7f06ec09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.395 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 -- 172.21.15.157:0/3770625241 shutdown_connections 2020-07-16T20:30:45.395 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.383+0000 7f06f0fbb700 1 -- 172.21.15.157:0/3770625241 wait complete. 2020-07-16T20:30:45.395 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.384+0000 7f06f0fbb700 1 Processor -- start 2020-07-16T20:30:45.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.384+0000 7f06f0fbb700 1 -- start start 2020-07-16T20:30:45.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a7470 0x7f06ec0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.401 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec133860 0x7f06ec0a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06ec09fd50 0x7f06ec0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec1452c0 con 0x7f06ec09fd50 2020-07-16T20:30:45.402 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec1454a0 con 0x7f06ec0a7470 2020-07-16T20:30:45.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06f0fbb700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec145740 con 0x7f06ec133860 2020-07-16T20:30:45.403 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a7470 0x7f06ec0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06ec0a7470 0x7f06ec0aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33554/0 (socket says 172.21.15.157:33554) 2020-07-16T20:30:45.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 -- 172.21.15.157:0/451756286 learned_addr learned my addr 172.21.15.157:0/451756286 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:45.404 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 -- 172.21.15.157:0/451756286 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec133860 msgr2=0x7f06ec0a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec133860 0x7f06ec0a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:45.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 -- 172.21.15.157:0/451756286 >> v2:172.21.15.41:3300/0 conn(0x7f06ec09fd50 msgr2=0x7f06ec0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 --2- 172.21.15.157:0/451756286 >> v2:172.21.15.41:3300/0 conn(0x7f06ec09fd50 0x7f06ec0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:45.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 -- 172.21.15.157:0/451756286 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0aabe0 con 0x7f06ec0a7470 2020-07-16T20:30:45.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.385+0000 7f06ea59c700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a7470 0x7f06ec0aaef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f06ec09f6e0 tx=0x7f06e0006dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.386+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000cae0 con 0x7f06ec0a7470 2020-07-16T20:30:45.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.386+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000cc40 con 0x7f06ec0a7470 2020-07-16T20:30:45.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.386+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec0ab3e0 con 0x7f06ec0a7470 2020-07-16T20:30:45.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.386+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e00123f0 con 0x7f06ec0a7470 2020-07-16T20:30:45.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.386+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec144e40 con 0x7f06ec0a7470 2020-07-16T20:30:45.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec057490 con 0x7f06ec0a7470 2020-07-16T20:30:45.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f06e00125e0 con 0x7f06ec0a7470 2020-07-16T20:30:45.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06da7fc700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 0x7f06c0052460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f06e0067e30 con 0x7f06ec0a7470 2020-07-16T20:30:45.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06e9d9b700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 0x7f06c0052460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.387+0000 7f06e9d9b700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 0x7f06c0052460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f06dc00e000 tx=0x7f06dc006e60).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.390+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f06e00409f0 con 0x7f06ec0a7470 2020-07-16T20:30:45.539 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.538+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06ec043fd0 con 0x7f06ec0a7470 2020-07-16T20:30:45.540 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.538+0000 7f06da7fc700 1 -- 172.21.15.157:0/451756286 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06e0044010 con 0x7f06ec0a7470 2020-07-16T20:30:45.540 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:30:45.554 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 msgr2=0x7f06c0052460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.554 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 0x7f06c0052460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f06dc00e000 tx=0x7f06dc006e60).stop 2020-07-16T20:30:45.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a7470 msgr2=0x7f06ec0aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a7470 0x7f06ec0aaef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f06ec09f6e0 tx=0x7f06e0006dd0).stop 2020-07-16T20:30:45.555 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 shutdown_connections 2020-07-16T20:30:45.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f06c004ffa0 0x7f06c0052460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> v2:172.21.15.41:3300/0 conn(0x7f06ec09fd50 0x7f06ec0a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:45.556 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06ec0a7470 0x7f06ec0aaef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 --2- 172.21.15.157:0/451756286 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f06ec133860 0x7f06ec0a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:45.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 >> 172.21.15.157:0/451756286 conn(0x7f06ec09e7e0 msgr2=0x7f06ec12fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.557 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 shutdown_connections 2020-07-16T20:30:45.558 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.539+0000 7f06f0fbb700 1 -- 172.21.15.157:0/451756286 wait complete. 2020-07-16T20:30:45.570 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 Processor -- start 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 -- start start 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7fead0141b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00a5370 con 0x7fead00a4d10 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00a7880 con 0x7fead00a4930 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7fead6034700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00a55c0 con 0x7fead01337c0 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7feacf7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fead00a4930 0x7fead00a7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36250/0 (socket says 172.21.15.157:36250) 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.677+0000 7feacf7fe700 1 -- 172.21.15.157:0/3095848966 learned_addr learned my addr 172.21.15.157:0/3095848966 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feacffff700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7fead0141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471361158 0 0) 0x7fead00a7880 con 0x7fead00a4930 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feabc003240 con 0x7fead00a4930 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192303250 0 0) 0x7fead00a5370 con 0x7fead00a4d10 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead00a7880 con 0x7fead00a4d10 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3887358605 0 0) 0x7feabc003240 con 0x7fead00a4930 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 msgr2=0x7fead0141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7fead0141b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 >> v1:172.21.15.41:6789/0 conn(0x7fead00a4d10 legacy=0x7fead01330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00a5860 con 0x7fead00a4930 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7feac0001a90 con 0x7fead00a4930 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 >> v1:172.21.15.157:6789/0 conn(0x7fead00a4930 legacy=0x7fead00a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7feabc0038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feabc003e00 0x7feabc0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feabc0049d0 0x7feabc004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00a55c0 con 0x7feabc0049d0 2020-07-16T20:30:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0053a0 con 0x7feabc003e00 2020-07-16T20:30:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc00b7b0 con 0x7fead01337c0 2020-07-16T20:30:45.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feabc003e00 0x7feabc0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feacf7fe700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7feabc0038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feacffff700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feabc0049d0 0x7feabc004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 -- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 msgr2=0x7feabc0038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead01337c0 0x7feabc0038c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 -- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feabc0049d0 msgr2=0x7feabc004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feabc0049d0 0x7feabc004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 -- 172.21.15.157:0/3095848966 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc003240 con 0x7feabc003e00 2020-07-16T20:30:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feacffff700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feabc0049d0 0x7feabc004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.678+0000 7feaceffd700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feabc003e00 0x7feabc0044e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7feac40010d0 tx=0x7feac4007b70).ready entity=mon.1 client_cookie=2a8d53389e70a6c7 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac400c870 con 0x7feabc003e00 2020-07-16T20:30:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac400c9d0 con 0x7feabc003e00 2020-07-16T20:30:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7feace7fc700 1 -- 172.21.15.157:0/3095848966 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac400cd30 con 0x7feabc003e00 2020-07-16T20:30:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 -- 172.21.15.157:0/3095848966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feabc003e00 msgr2=0x7feabc0044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 --2- 172.21.15.157:0/3095848966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feabc003e00 0x7feabc0044e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7feac40010d0 tx=0x7feac4007b70).stop 2020-07-16T20:30:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7feacffff700 1 -- 172.21.15.157:0/3095848966 reap_dead start 2020-07-16T20:30:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 -- 172.21.15.157:0/3095848966 shutdown_connections 2020-07-16T20:30:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 -- 172.21.15.157:0/3095848966 >> 172.21.15.157:0/3095848966 conn(0x7fead0061820 msgr2=0x7fead009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 -- 172.21.15.157:0/3095848966 shutdown_connections 2020-07-16T20:30:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.679+0000 7fead6034700 1 -- 172.21.15.157:0/3095848966 wait complete. 2020-07-16T20:30:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.680+0000 7fead6034700 1 Processor -- start 2020-07-16T20:30:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.680+0000 7fead6034700 1 -- start start 2020-07-16T20:30:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7fead6034700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fead012b980 0x7fead0149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7fead6034700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead0123540 0x7fead01239a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7fead6034700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead0149640 con 0x7fead0126800 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7fead6034700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead01498e0 con 0x7fead012b980 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7fead6034700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0126be0 con 0x7fead0123540 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feacf7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fead0126800 0x7fead01291d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36262/0 (socket says 172.21.15.157:36262) 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feacf7fe700 1 -- 172.21.15.157:0/4006210738 learned_addr learned my addr 172.21.15.157:0/4006210738 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaceffd700 1 --2- 172.21.15.157:0/4006210738 >> v2:172.21.15.157:3300/0 conn(0x7fead012b980 0x7fead0149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feacffff700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead0123540 0x7fead01239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566869174 0 0) 0x7fead0149640 con 0x7fead0126800 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa8003240 con 0x7fead0126800 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaceffd700 1 -- 172.21.15.157:0/4006210738 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead0123540 msgr2=0x7fead01239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaceffd700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead0123540 0x7fead01239a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaceffd700 1 -- 172.21.15.157:0/4006210738 >> v1:172.21.15.157:6789/0 conn(0x7fead0126800 legacy=0x7fead01291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.681+0000 7feaceffd700 1 -- 172.21.15.157:0/4006210738 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead014a270 con 0x7fead012b980 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7feaceffd700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fead012b980 0x7fead0149d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7feac40010d0 tx=0x7feac4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac4006970 con 0x7fead012b980 2020-07-16T20:30:45.700 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4006ad0 con 0x7fead012b980 2020-07-16T20:30:45.700 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead0127b10 con 0x7fead012b980 2020-07-16T20:30:45.700 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac4006e30 con 0x7fead012b980 2020-07-16T20:30:45.700 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.682+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0124050 con 0x7fead012b980 2020-07-16T20:30:45.700 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7feac4010070 con 0x7fead012b980 2020-07-16T20:30:45.701 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead01300c0 con 0x7fead012b980 2020-07-16T20:30:45.701 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7feaaf7fe700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 0x7feaa8052840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.701 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7feac4068ae0 con 0x7fead012b980 2020-07-16T20:30:45.701 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7feacf7fe700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 0x7feaa8052840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.701 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.683+0000 7feacf7fe700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 0x7feaa8052840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7feac000d000 tx=0x7feac0007a20).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.702 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.686+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7feac4045130 con 0x7fead012b980 2020-07-16T20:30:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.836+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fead0057490 con 0x7fead012b980 2020-07-16T20:30:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.837+0000 7feaaf7fe700 1 -- 172.21.15.157:0/4006210738 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7feac4044d20 con 0x7fead012b980 2020-07-16T20:30:45.839 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:45.840 INFO:teuthology.orchestra.run.smithi157.stdout:[ 2020-07-16T20:30:45.840 INFO:teuthology.orchestra.run.smithi157.stdout: { 2020-07-16T20:30:45.840 INFO:teuthology.orchestra.run.smithi157.stdout: "poolnum": 1, 2020-07-16T20:30:45.841 INFO:teuthology.orchestra.run.smithi157.stdout: "poolname": "device_health_metrics" 2020-07-16T20:30:45.841 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2020-07-16T20:30:45.841 INFO:teuthology.orchestra.run.smithi157.stdout: { 2020-07-16T20:30:45.841 INFO:teuthology.orchestra.run.smithi157.stdout: "poolnum": 2, 2020-07-16T20:30:45.842 INFO:teuthology.orchestra.run.smithi157.stdout: "poolname": "rbd" 2020-07-16T20:30:45.842 INFO:teuthology.orchestra.run.smithi157.stdout: } 2020-07-16T20:30:45.842 INFO:teuthology.orchestra.run.smithi157.stdout:] 2020-07-16T20:30:45.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 msgr2=0x7feaa8052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 0x7feaa8052840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7feac000d000 tx=0x7feac0007a20).stop 2020-07-16T20:30:45.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fead012b980 msgr2=0x7fead0149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fead012b980 0x7fead0149d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7feac40010d0 tx=0x7feac4017000).stop 2020-07-16T20:30:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 shutdown_connections 2020-07-16T20:30:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7feaa8050380 0x7feaa8052840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fead0123540 0x7fead01239a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 --2- 172.21.15.157:0/4006210738 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fead012b980 0x7fead0149d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.845 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 >> 172.21.15.157:0/4006210738 conn(0x7fead0061820 msgr2=0x7fead009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.845 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 shutdown_connections 2020-07-16T20:30:45.845 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.838+0000 7fead6034700 1 -- 172.21.15.157:0/4006210738 wait complete. 2020-07-16T20:30:45.849 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-07-16T20:30:45.850 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-07-16T20:30:45.971 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 Processor -- start 2020-07-16T20:30:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 -- start start 2020-07-16T20:30:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f886c0a7470 0x7f886c133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f886c133860 0x7f886c0a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c133cc0 con 0x7f886c0a8800 2020-07-16T20:30:45.973 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c0a4710 con 0x7f886c0a7470 2020-07-16T20:30:45.973 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f88725df700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0a5c00 con 0x7f886c133860 2020-07-16T20:30:45.973 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.958+0000 7f886bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f886c0a7470 0x7f886c133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.973 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f8870b7c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f886c0a8800 0x7f886c139840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36270/0 (socket says 172.21.15.157:36270) 2020-07-16T20:30:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f8870b7c700 1 -- 172.21.15.157:0/382737047 learned_addr learned my addr 172.21.15.157:0/382737047 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886b7fe700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f886c133860 0x7f886c0a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886bfff700 1 -- 172.21.15.157:0/382737047 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f886c133860 msgr2=0x7f886c0a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886bfff700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f886c133860 0x7f886c0a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886bfff700 1 -- 172.21.15.157:0/382737047 >> v1:172.21.15.157:6789/0 conn(0x7f886c0a8800 legacy=0x7f886c139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886bfff700 1 -- 172.21.15.157:0/382737047 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0a9110 con 0x7f886c0a7470 2020-07-16T20:30:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886affd700 1 -- 172.21.15.157:0/382737047 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499526816 0 0) 0x7f8864001450 con 0x7f886c0a8800 2020-07-16T20:30:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886bfff700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c0a7470 0x7f886c133370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f885c002f30 tx=0x7f885c006dd0).ready entity=mon.1 client_cookie=ef2a1cd8aef2e78a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886affd700 1 -- 172.21.15.157:0/382737047 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885c0097f0 con 0x7f886c0a7470 2020-07-16T20:30:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886affd700 1 -- 172.21.15.157:0/382737047 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c009950 con 0x7f886c0a7470 2020-07-16T20:30:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f886affd700 1 -- 172.21.15.157:0/382737047 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885c009cb0 con 0x7f886c0a7470 2020-07-16T20:30:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 -- 172.21.15.157:0/382737047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c0a7470 msgr2=0x7f886c133370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c0a7470 0x7f886c133370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f885c002f30 tx=0x7f885c006dd0).stop 2020-07-16T20:30:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 -- 172.21.15.157:0/382737047 shutdown_connections 2020-07-16T20:30:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c0a7470 0x7f886c133370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 --2- 172.21.15.157:0/382737047 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f886c133860 0x7f886c0a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 -- 172.21.15.157:0/382737047 >> 172.21.15.157:0/382737047 conn(0x7f886c09e7e0 msgr2=0x7f886c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 -- 172.21.15.157:0/382737047 shutdown_connections 2020-07-16T20:30:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.959+0000 7f88725df700 1 -- 172.21.15.157:0/382737047 wait complete. 2020-07-16T20:30:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.960+0000 7f88725df700 1 Processor -- start 2020-07-16T20:30:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 -- start start 2020-07-16T20:30:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f886c0a8800 0x7f886c1378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f886c12a180 0x7f886c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c1396a0 con 0x7f886c133860 2020-07-16T20:30:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c139940 con 0x7f886c0a8800 2020-07-16T20:30:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f88725df700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c139c20 con 0x7f886c12a180 2020-07-16T20:30:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f8870b7c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f886c12a180 0x7f886c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f886b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f886c133860 0x7f886c129a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36276/0 (socket says 172.21.15.157:36276) 2020-07-16T20:30:45.980 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f886b7fe700 1 -- 172.21.15.157:0/3708146447 learned_addr learned my addr 172.21.15.157:0/3708146447 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:45.980 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.961+0000 7f886bfff700 1 --2- 172.21.15.157:0/3708146447 >> v2:172.21.15.41:3300/0 conn(0x7f886c0a8800 0x7f886c1378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.980 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f8870b7c700 1 -- 172.21.15.157:0/3708146447 >> v2:172.21.15.41:3300/0 conn(0x7f886c0a8800 msgr2=0x7f886c1378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.980 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f8870b7c700 1 --2- 172.21.15.157:0/3708146447 >> v2:172.21.15.41:3300/0 conn(0x7f886c0a8800 0x7f886c1378c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.980 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f8870b7c700 1 -- 172.21.15.157:0/3708146447 >> v1:172.21.15.157:6789/0 conn(0x7f886c133860 legacy=0x7f886c129a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f8870b7c700 1 -- 172.21.15.157:0/3708146447 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c136990 con 0x7f886c12a180 2020-07-16T20:30:45.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215351086 0 0) 0x7f886c1396a0 con 0x7f886c133860 2020-07-16T20:30:45.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f8870b7c700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c12a180 0x7f886c13a0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8864000f00 tx=0x7f8864007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f886400ce40 con 0x7f886c12a180 2020-07-16T20:30:45.981 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8864005b80 con 0x7f886c12a180 2020-07-16T20:30:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0ac250 con 0x7f886c12a180 2020-07-16T20:30:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8864007110 con 0x7f886c12a180 2020-07-16T20:30:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.962+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0ab420 con 0x7f886c12a180 2020-07-16T20:30:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8864010030 con 0x7f886c12a180 2020-07-16T20:30:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c057490 con 0x7f886c12a180 2020-07-16T20:30:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f884bfff700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 0x7f8844052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8864067530 con 0x7f886c12a180 2020-07-16T20:30:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f886bfff700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 0x7f8844052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.963+0000 7f886bfff700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 0x7f8844052320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f885c01c000 tx=0x7f885c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:45.966+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f8864040150 con 0x7f886c12a180 2020-07-16T20:30:46.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.112+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f886c133cc0 con 0x7f886c12a180 2020-07-16T20:30:46.709 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.708+0000 7f884bfff700 1 -- 172.21.15.157:0/3708146447 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f886c133cc0 con 0x7f886c12a180 2020-07-16T20:30:46.711 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 msgr2=0x7f8844052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.712 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 0x7f8844052320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f885c01c000 tx=0x7f885c015000).stop 2020-07-16T20:30:46.712 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c12a180 msgr2=0x7f886c13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.712 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c12a180 0x7f886c13a0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8864000f00 tx=0x7f8864007ad0).stop 2020-07-16T20:30:46.712 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 shutdown_connections 2020-07-16T20:30:46.713 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f884404fe60 0x7f8844052320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.713 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 --2- 172.21.15.157:0/3708146447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f886c12a180 0x7f886c13a0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.713 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 --2- 172.21.15.157:0/3708146447 >> v2:172.21.15.41:3300/0 conn(0x7f886c0a8800 0x7f886c1378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.713 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.709+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 >> 172.21.15.157:0/3708146447 conn(0x7f886c09e7e0 msgr2=0x7f886c12f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.716 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.710+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 shutdown_connections 2020-07-16T20:30:46.716 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.710+0000 7f88725df700 1 -- 172.21.15.157:0/3708146447 wait complete. 2020-07-16T20:30:46.717 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_metadata' created 2020-07-16T20:30:46.725 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-07-16T20:30:46.727 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-07-16T20:30:46.841 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.840+0000 7fd20b18e700 1 Processor -- start 2020-07-16T20:30:46.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.840+0000 7fd20b18e700 1 -- start start 2020-07-16T20:30:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20b18e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd20409eb50 0x7fd2041373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20b18e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd204137890 0x7fd2040aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20b18e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd204137d40 con 0x7fd20409ef30 2020-07-16T20:30:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20b18e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd204134d20 con 0x7fd204137890 2020-07-16T20:30:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20b18e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20405c500 con 0x7fd20409eb50 2020-07-16T20:30:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd20409eb50 0x7fd2041373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20998b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd20409ef30 0x7fd2040aa2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36282/0 (socket says 172.21.15.157:36282) 2020-07-16T20:30:46.848 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd20409eb50 0x7fd2041373a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33594/0 (socket says 172.21.15.157:33594) 2020-07-16T20:30:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20998b700 1 -- 172.21.15.157:0/4140674895 learned_addr learned my addr 172.21.15.157:0/4140674895 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a98d700 1 --2- 172.21.15.157:0/4140674895 >> v2:172.21.15.41:3300/0 conn(0x7fd204137890 0x7fd2040aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 -- 172.21.15.157:0/4140674895 >> v2:172.21.15.41:3300/0 conn(0x7fd204137890 msgr2=0x7fd2040aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 --2- 172.21.15.157:0/4140674895 >> v2:172.21.15.41:3300/0 conn(0x7fd204137890 0x7fd2040aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 -- 172.21.15.157:0/4140674895 >> v1:172.21.15.157:6789/0 conn(0x7fd20409ef30 legacy=0x7fd2040aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20918a700 1 -- 172.21.15.157:0/4140674895 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866767148 0 0) 0x7fd204137d40 con 0x7fd20409ef30 2020-07-16T20:30:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 -- 172.21.15.157:0/4140674895 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040a0680 con 0x7fd20409eb50 2020-07-16T20:30:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.841+0000 7fd20a18c700 1 --2- 172.21.15.157:0/4140674895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20409eb50 0x7fd2041373a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd2040a05a0 tx=0x7fd1f4006dd0).ready entity=mon.1 client_cookie=2eca9672318c863f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20918a700 1 -- 172.21.15.157:0/4140674895 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f40097b0 con 0x7fd20409eb50 2020-07-16T20:30:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20918a700 1 -- 172.21.15.157:0/4140674895 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4009910 con 0x7fd20409eb50 2020-07-16T20:30:46.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20918a700 1 -- 172.21.15.157:0/4140674895 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f4009c70 con 0x7fd20409eb50 2020-07-16T20:30:46.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 -- 172.21.15.157:0/4140674895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20409eb50 msgr2=0x7fd2041373a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 --2- 172.21.15.157:0/4140674895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20409eb50 0x7fd2041373a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd2040a05a0 tx=0x7fd1f4006dd0).stop 2020-07-16T20:30:46.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 -- 172.21.15.157:0/4140674895 shutdown_connections 2020-07-16T20:30:46.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 --2- 172.21.15.157:0/4140674895 >> v2:172.21.15.41:3300/0 conn(0x7fd204137890 0x7fd2040aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 --2- 172.21.15.157:0/4140674895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd20409eb50 0x7fd2041373a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 -- 172.21.15.157:0/4140674895 >> 172.21.15.157:0/4140674895 conn(0x7fd204063800 msgr2=0x7fd20405b810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 -- 172.21.15.157:0/4140674895 shutdown_connections 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.842+0000 7fd20b18e700 1 -- 172.21.15.157:0/4140674895 wait complete. 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.843+0000 7fd20b18e700 1 Processor -- start 2020-07-16T20:30:46.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.843+0000 7fd20b18e700 1 -- start start 2020-07-16T20:30:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd204137890 0x7fd204066f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 0x7fd204065d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd204066280 con 0x7fd20409ef30 2020-07-16T20:30:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd204067ac0 con 0x7fd204137890 2020-07-16T20:30:46.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040a1aa0 con 0x7fd204065900 2020-07-16T20:30:46.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd204137890 0x7fd204066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd204137890 0x7fd204066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33602/0 (socket says 172.21.15.157:33602) 2020-07-16T20:30:46.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 -- 172.21.15.157:0/3650732753 learned_addr learned my addr 172.21.15.157:0/3650732753 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:46.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20a18c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd20409ef30 0x7fd20413a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36288/0 (socket says 172.21.15.157:36288) 2020-07-16T20:30:46.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20a98d700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 0x7fd204065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 -- 172.21.15.157:0/3650732753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 msgr2=0x7fd204065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 0x7fd204065d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 -- 172.21.15.157:0/3650732753 >> v1:172.21.15.157:6789/0 conn(0x7fd20409ef30 legacy=0x7fd20413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 -- 172.21.15.157:0/3650732753 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040a1d40 con 0x7fd204137890 2020-07-16T20:30:46.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246603507 0 0) 0x7fd204066280 con 0x7fd20409ef30 2020-07-16T20:30:46.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20a98d700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 0x7fd204065d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:46.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20998b700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd204137890 0x7fd204066f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd200000b80 tx=0x7fd200007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd200007320 con 0x7fd204137890 2020-07-16T20:30:46.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200007480 con 0x7fd204137890 2020-07-16T20:30:46.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2000057e0 con 0x7fd204137890 2020-07-16T20:30:46.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2040a1fe0 con 0x7fd204137890 2020-07-16T20:30:46.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.844+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041309e0 con 0x7fd204137890 2020-07-16T20:30:46.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.845+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd200010030 con 0x7fd204137890 2020-07-16T20:30:46.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.845+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2040a21a0 con 0x7fd204137890 2020-07-16T20:30:46.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.845+0000 7fd1f27fc700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 0x7fd1dc052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.846+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd200067700 con 0x7fd204137890 2020-07-16T20:30:46.863 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.846+0000 7fd20a18c700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 0x7fd1dc052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.863 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.846+0000 7fd20a18c700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 0x7fd1dc052360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd1f4006a40 tx=0x7fd1f4015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:46.849+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fd200040140 con 0x7fd204137890 2020-07-16T20:30:47.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.008+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd2040a0da0 con 0x7fd204137890 2020-07-16T20:30:47.710 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.709+0000 7fd1f27fc700 1 -- 172.21.15.157:0/3650732753 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fd200043760 con 0x7fd204137890 2020-07-16T20:30:47.716 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 msgr2=0x7fd1dc052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.717 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 0x7fd1dc052360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd1f4006a40 tx=0x7fd1f4015000).stop 2020-07-16T20:30:47.717 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd204137890 msgr2=0x7fd204066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd204137890 0x7fd204066f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd200000b80 tx=0x7fd200007a20).stop 2020-07-16T20:30:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 shutdown_connections 2020-07-16T20:30:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd1dc04fea0 0x7fd1dc052360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd204065900 0x7fd204065d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 --2- 172.21.15.157:0/3650732753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd204137890 0x7fd204066f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.711+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 >> 172.21.15.157:0/3650732753 conn(0x7fd204063800 msgr2=0x7fd2040aaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.712+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 shutdown_connections 2020-07-16T20:30:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.712+0000 7fd20b18e700 1 -- 172.21.15.157:0/3650732753 wait complete. 2020-07-16T20:30:47.727 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.840+0000 7ff8efe5b700 1 Processor -- start 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.840+0000 7ff8efe5b700 1 -- start start 2020-07-16T20:30:47.849 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e80abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80a5450 con 0x7ff8e80a7fb0 2020-07-16T20:30:47.850 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80a7880 con 0x7ff8e80a8420 2020-07-16T20:30:47.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80a56b0 con 0x7ff8e80a48e0 2020-07-16T20:30:47.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33608/0 (socket says 172.21.15.157:33608) 2020-07-16T20:30:47.851 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 -- 172.21.15.157:0/2877095075 learned_addr learned my addr 172.21.15.157:0/2877095075 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:47.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8ee3f8700 1 --2- 172.21.15.157:0/2877095075 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e80abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 -- 172.21.15.157:0/2877095075 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 msgr2=0x7ff8e80abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:47.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 --2- 172.21.15.157:0/2877095075 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e80abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.852 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 -- 172.21.15.157:0/2877095075 >> v1:172.21.15.41:6789/0 conn(0x7ff8e80a7fb0 legacy=0x7ff8e80ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:47.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 -- 172.21.15.157:0/2877095075 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80a5950 con 0x7ff8e80a48e0 2020-07-16T20:30:47.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8edbf7700 1 --2- 172.21.15.157:0/2877095075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff8e81361f0 tx=0x7ff8d8006e90).ready entity=mon.1 client_cookie=9ee108f694a56aea server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8ecbf5700 1 -- 172.21.15.157:0/2877095075 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d8009930 con 0x7ff8e80a48e0 2020-07-16T20:30:47.853 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8ecbf5700 1 -- 172.21.15.157:0/2877095075 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8009a90 con 0x7ff8e80a48e0 2020-07-16T20:30:47.854 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8ecbf5700 1 -- 172.21.15.157:0/2877095075 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d8009e30 con 0x7ff8e80a48e0 2020-07-16T20:30:47.855 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 -- 172.21.15.157:0/2877095075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a48e0 msgr2=0x7ff8e80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.856 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.841+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/2877095075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff8e81361f0 tx=0x7ff8d8006e90).stop 2020-07-16T20:30:47.857 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 -- 172.21.15.157:0/2877095075 shutdown_connections 2020-07-16T20:30:47.857 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/2877095075 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e80abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/2877095075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a48e0 0x7ff8e80a4cc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.858 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 -- 172.21.15.157:0/2877095075 >> 172.21.15.157:0/2877095075 conn(0x7ff8e8061820 msgr2=0x7ff8e809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 -- 172.21.15.157:0/2877095075 shutdown_connections 2020-07-16T20:30:47.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.842+0000 7ff8efe5b700 1 -- 172.21.15.157:0/2877095075 wait complete. 2020-07-16T20:30:47.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.843+0000 7ff8efe5b700 1 Processor -- start 2020-07-16T20:30:47.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.843+0000 7ff8efe5b700 1 -- start start 2020-07-16T20:30:47.859 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e81496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a9d30 0x7ff8e80aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e8149d80 con 0x7ff8e80a7fb0 2020-07-16T20:30:47.860 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80ab970 con 0x7ff8e80a8420 2020-07-16T20:30:47.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e814a020 con 0x7ff8e80a9d30 2020-07-16T20:30:47.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a9d30 0x7ff8e80aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff8e80a9d30 0x7ff8e80aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33618/0 (socket says 172.21.15.157:33618) 2020-07-16T20:30:47.861 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 -- 172.21.15.157:0/3859110698 learned_addr learned my addr 172.21.15.157:0/3859110698 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:47.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ed3f6700 1 --2- 172.21.15.157:0/3859110698 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e81496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 -- 172.21.15.157:0/3859110698 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 msgr2=0x7ff8e81496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 --2- 172.21.15.157:0/3859110698 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e81496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 -- 172.21.15.157:0/3859110698 >> v1:172.21.15.157:6789/0 conn(0x7ff8e80a7fb0 legacy=0x7ff8e80a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.862 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186556249 0 0) 0x7ff8e8149d80 con 0x7ff8e80a7fb0 2020-07-16T20:30:47.863 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 -- 172.21.15.157:0/3859110698 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e814a2c0 con 0x7ff8e80a9d30 2020-07-16T20:30:47.863 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8ee3f8700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a9d30 0x7ff8e80aae10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff8e81471d0 tx=0x7ff8e0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.863 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0009aa0 con 0x7ff8e80a9d30 2020-07-16T20:30:47.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0009c00 con 0x7ff8e80a9d30 2020-07-16T20:30:47.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e809f950 con 0x7ff8e80a9d30 2020-07-16T20:30:47.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0013480 con 0x7ff8e80a9d30 2020-07-16T20:30:47.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.844+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e812dbf0 con 0x7ff8e80a9d30 2020-07-16T20:30:47.865 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.845+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff8e0013630 con 0x7ff8e80a9d30 2020-07-16T20:30:47.865 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.845+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8057490 con 0x7ff8e80a9d30 2020-07-16T20:30:47.867 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.845+0000 7ff8d5ffb700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 0x7ff8c0052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.846+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7ff8e0068510 con 0x7ff8e80a9d30 2020-07-16T20:30:47.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.846+0000 7ff8edbf7700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 0x7ff8c0052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.846+0000 7ff8edbf7700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 0x7ff8c0052320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff8d80093a0 tx=0x7ff8d8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.869 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.849+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff8e0040ed0 con 0x7ff8e80a9d30 2020-07-16T20:30:47.999 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:47.998+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7ff8e80a3360 con 0x7ff8e80a9d30 2020-07-16T20:30:49.724 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.722+0000 7ff8d5ffb700 1 -- 172.21.15.157:0/3859110698 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7ff8e00444f0 con 0x7ff8e80a9d30 2020-07-16T20:30:49.729 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.726+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 msgr2=0x7ff8c0052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.726+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 0x7ff8c0052320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff8d80093a0 tx=0x7ff8d8015000).stop 2020-07-16T20:30:49.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.726+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a9d30 msgr2=0x7ff8e80aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.726+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a9d30 0x7ff8e80aae10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff8e81471d0 tx=0x7ff8e0008040).stop 2020-07-16T20:30:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.727+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 shutdown_connections 2020-07-16T20:30:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.727+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff8c004fe60 0x7ff8c0052320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.727+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/3859110698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8e80a9d30 0x7ff8e80aae10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.727+0000 7ff8efe5b700 1 --2- 172.21.15.157:0/3859110698 >> v2:172.21.15.41:3300/0 conn(0x7ff8e80a8420 0x7ff8e81496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.727+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 >> 172.21.15.157:0/3859110698 conn(0x7ff8e8061820 msgr2=0x7ff8e805bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.728+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 shutdown_connections 2020-07-16T20:30:49.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.728+0000 7ff8efe5b700 1 -- 172.21.15.157:0/3859110698 wait complete. 2020-07-16T20:30:49.733 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data' created 2020-07-16T20:30:49.742 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-07-16T20:30:49.832 INFO:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:49.836 INFO:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:49.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.861+0000 7f2ec5b22700 1 Processor -- start 2020-07-16T20:30:49.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.861+0000 7f2ec5b22700 1 -- start start 2020-07-16T20:30:49.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ec5b22700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 0x7f2ec01395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ec5b22700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00b00d0 con 0x7f2ec0139aa0 2020-07-16T20:30:49.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ec5b22700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec005b810 con 0x7f2ec00a70c0 2020-07-16T20:30:49.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ec5b22700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec005bab0 con 0x7f2ec00a74a0 2020-07-16T20:30:49.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ebf7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2ec00a70c0 0x7f2ec00ab9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36310/0 (socket says 172.21.15.157:36310) 2020-07-16T20:30:49.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ebf7fe700 1 -- 172.21.15.157:0/1196518995 learned_addr learned my addr 172.21.15.157:0/1196518995 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:49.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ebeffd700 1 --2- 172.21.15.157:0/1196518995 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 0x7f2ec01395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144961453 0 0) 0x7f2ec005b810 con 0x7f2ec00a70c0 2020-07-16T20:30:49.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.862+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea0003240 con 0x7f2ec00a70c0 2020-07-16T20:30:49.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477440414 0 0) 0x7f2ec00b00d0 con 0x7f2ec0139aa0 2020-07-16T20:30:49.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec005b810 con 0x7f2ec0139aa0 2020-07-16T20:30:49.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebeffd700 1 -- 172.21.15.157:0/1196518995 >> v1:172.21.15.157:6789/0 conn(0x7f2ec00a70c0 legacy=0x7f2ec00ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4292786413 0 0) 0x7f2ea0003240 con 0x7f2ec00a70c0 2020-07-16T20:30:49.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebeffd700 1 -- 172.21.15.157:0/1196518995 >> v1:172.21.15.41:6789/0 conn(0x7f2ec0139aa0 legacy=0x7f2ec01440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebeffd700 1 -- 172.21.15.157:0/1196518995 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec005bd50 con 0x7f2ec00a74a0 2020-07-16T20:30:49.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebeffd700 1 --2- 172.21.15.157:0/1196518995 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 0x7f2ec01395b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2eb8001490 tx=0x7f2ea8006dd0).ready entity=mon.2 client_cookie=7f1c3c7fb120c7a1 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb8001a90 con 0x7f2ec00a74a0 2020-07-16T20:30:49.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ebe7fc700 1 -- 172.21.15.157:0/1196518995 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800d5c0 con 0x7f2ec00a74a0 2020-07-16T20:30:49.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 -- 172.21.15.157:0/1196518995 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 msgr2=0x7f2ec01395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/1196518995 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 0x7f2ec01395b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2eb8001490 tx=0x7f2ea8006dd0).stop 2020-07-16T20:30:49.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 -- 172.21.15.157:0/1196518995 shutdown_connections 2020-07-16T20:30:49.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/1196518995 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec00a74a0 0x7f2ec01395b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 -- 172.21.15.157:0/1196518995 >> 172.21.15.157:0/1196518995 conn(0x7f2ec00ac6a0 msgr2=0x7f2ec00acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 -- 172.21.15.157:0/1196518995 shutdown_connections 2020-07-16T20:30:49.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.863+0000 7f2ec5b22700 1 -- 172.21.15.157:0/1196518995 wait complete. 2020-07-16T20:30:49.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.865+0000 7f2ec5b22700 1 Processor -- start 2020-07-16T20:30:49.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.865+0000 7f2ec5b22700 1 -- start start 2020-07-16T20:30:49.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2ec00a70c0 0x7f2ec013a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec0139aa0 0x7f2ec01344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ec0148e30 0x7f2ec013bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0138550 con 0x7f2ec00a70c0 2020-07-16T20:30:49.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0138760 con 0x7f2ec0148e30 2020-07-16T20:30:49.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0138a00 con 0x7f2ec0139aa0 2020-07-16T20:30:49.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ec0148e30 0x7f2ec013bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ec0148e30 0x7f2ec013bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33632/0 (socket says 172.21.15.157:33632) 2020-07-16T20:30:49.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 -- 172.21.15.157:0/3044689019 learned_addr learned my addr 172.21.15.157:0/3044689019 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:49.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebf7fe700 1 --2- 172.21.15.157:0/3044689019 >> v2:172.21.15.41:3300/0 conn(0x7f2ec00a70c0 0x7f2ec013a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebeffd700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec0139aa0 0x7f2ec01344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 -- 172.21.15.157:0/3044689019 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec0139aa0 msgr2=0x7f2ec01344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec0139aa0 0x7f2ec01344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 -- 172.21.15.157:0/3044689019 >> v2:172.21.15.41:3300/0 conn(0x7f2ec00a70c0 msgr2=0x7f2ec013a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 --2- 172.21.15.157:0/3044689019 >> v2:172.21.15.41:3300/0 conn(0x7f2ec00a70c0 0x7f2ec013a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 -- 172.21.15.157:0/3044689019 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec01349d0 con 0x7f2ec0148e30 2020-07-16T20:30:49.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ebffff700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec0148e30 0x7f2ec013bee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2eb00010d0 tx=0x7f2eb00079c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb000f470 con 0x7f2ec0148e30 2020-07-16T20:30:49.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000f5d0 con 0x7f2ec0148e30 2020-07-16T20:30:49.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb000f930 con 0x7f2ec0148e30 2020-07-16T20:30:49.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0138ea0 con 0x7f2ec0148e30 2020-07-16T20:30:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.866+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec01492e0 con 0x7f2ec0148e30 2020-07-16T20:30:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.867+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2eb0010070 con 0x7f2ec0148e30 2020-07-16T20:30:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.868+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec01495c0 con 0x7f2ec0148e30 2020-07-16T20:30:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.868+0000 7f2eb77fe700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 0x7f2e9c052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.868+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f2eb0066dc0 con 0x7f2ec0148e30 2020-07-16T20:30:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.868+0000 7f2ebf7fe700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 0x7f2e9c052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.868+0000 7f2ebf7fe700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 0x7f2e9c052490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2eb800d000 tx=0x7f2eb8000f00).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:49.871+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f2ec01495c0 con 0x7f2ec0148e30 2020-07-16T20:30:50.023 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.021+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f2ec01495c0 con 0x7f2ec0148e30 2020-07-16T20:30:50.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.731+0000 7f2eb77fe700 1 -- 172.21.15.157:0/3044689019 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7f2ec01495c0 con 0x7f2ec0148e30 2020-07-16T20:30:50.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.736+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 msgr2=0x7f2e9c052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.736+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 0x7f2e9c052490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2eb800d000 tx=0x7f2eb8000f00).stop 2020-07-16T20:30:50.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.736+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec0148e30 msgr2=0x7f2ec013bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.736+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec0148e30 0x7f2ec013bee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2eb00010d0 tx=0x7f2eb00079c0).stop 2020-07-16T20:30:50.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 shutdown_connections 2020-07-16T20:30:50.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2e9c04ffd0 0x7f2e9c052490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec0148e30 0x7f2ec013bee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> v2:172.21.15.41:3300/0 conn(0x7f2ec00a70c0 0x7f2ec013a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 --2- 172.21.15.157:0/3044689019 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2ec0139aa0 0x7f2ec01344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 >> 172.21.15.157:0/3044689019 conn(0x7f2ec00ac6a0 msgr2=0x7f2ec00aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 shutdown_connections 2020-07-16T20:30:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.737+0000 7f2ec5b22700 1 -- 172.21.15.157:0/3044689019 wait complete. 2020-07-16T20:30:50.743 INFO:teuthology.orchestra.run.smithi157.stderr:set pool 4 allow_ec_overwrites to true 2020-07-16T20:30:50.751 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-07-16T20:30:50.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.868+0000 7fe3d2529700 1 Processor -- start 2020-07-16T20:30:50.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.868+0000 7fe3d2529700 1 -- start start 2020-07-16T20:30:50.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d2529700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc133650 0x7fe3cc0a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d2529700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc068260 con 0x7fe3cc0a2ed0 2020-07-16T20:30:50.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d2529700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc067b20 con 0x7fe3cc0a7290 2020-07-16T20:30:50.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d2529700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc067dc0 con 0x7fe3cc133650 2020-07-16T20:30:50.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc133650 0x7fe3cc0a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc133650 0x7fe3cc0a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33636/0 (socket says 172.21.15.157:33636) 2020-07-16T20:30:50.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1527700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe3cc0a7290 0x7fe3cc09ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36324/0 (socket says 172.21.15.157:36324) 2020-07-16T20:30:50.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 -- 172.21.15.157:0/3642022529 learned_addr learned my addr 172.21.15.157:0/3642022529 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:50.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 -- 172.21.15.157:0/3642022529 >> v1:172.21.15.157:6789/0 conn(0x7fe3cc0a7290 legacy=0x7fe3cc09ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 -- 172.21.15.157:0/3642022529 >> v1:172.21.15.41:6789/0 conn(0x7fe3cc0a2ed0 legacy=0x7fe3cc132f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3bbfff700 1 -- 172.21.15.157:0/3642022529 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083069907 0 0) 0x7fe3cc067b20 con 0x7fe3cc0a7290 2020-07-16T20:30:50.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 -- 172.21.15.157:0/3642022529 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc0a7670 con 0x7fe3cc133650 2020-07-16T20:30:50.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.869+0000 7fe3d1d28700 1 --2- 172.21.15.157:0/3642022529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc133650 0x7fe3cc0a3330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe3c40032b0 tx=0x7fe3c4009270).ready entity=mon.1 client_cookie=dfe980bdb663e717 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3bbfff700 1 -- 172.21.15.157:0/3642022529 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c400bc00 con 0x7fe3cc133650 2020-07-16T20:30:50.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3bbfff700 1 -- 172.21.15.157:0/3642022529 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400bd60 con 0x7fe3cc133650 2020-07-16T20:30:50.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3bbfff700 1 -- 172.21.15.157:0/3642022529 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c4011400 con 0x7fe3cc133650 2020-07-16T20:30:50.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 -- 172.21.15.157:0/3642022529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc133650 msgr2=0x7fe3cc0a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 --2- 172.21.15.157:0/3642022529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc133650 0x7fe3cc0a3330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe3c40032b0 tx=0x7fe3c4009270).stop 2020-07-16T20:30:50.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 -- 172.21.15.157:0/3642022529 shutdown_connections 2020-07-16T20:30:50.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 --2- 172.21.15.157:0/3642022529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc133650 0x7fe3cc0a3330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 -- 172.21.15.157:0/3642022529 >> 172.21.15.157:0/3642022529 conn(0x7fe3cc05b810 msgr2=0x7fe3cc05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 -- 172.21.15.157:0/3642022529 shutdown_connections 2020-07-16T20:30:50.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.870+0000 7fe3d2529700 1 -- 172.21.15.157:0/3642022529 wait complete. 2020-07-16T20:30:50.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.871+0000 7fe3d2529700 1 Processor -- start 2020-07-16T20:30:50.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.871+0000 7fe3d2529700 1 -- start start 2020-07-16T20:30:50.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 0x7fe3cc0a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc0a7290 0x7fe3cc0668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 0x7fe3cc135c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc136400 con 0x7fe3cc0a2ed0 2020-07-16T20:30:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc133ea0 con 0x7fe3cc0a7290 2020-07-16T20:30:50.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d2529700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc134140 con 0x7fe3cc1345e0 2020-07-16T20:30:50.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc0a7290 0x7fe3cc0668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3cc0a7290 0x7fe3cc0668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33638/0 (socket says 172.21.15.157:33638) 2020-07-16T20:30:50.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 -- 172.21.15.157:0/2480249557 learned_addr learned my addr 172.21.15.157:0/2480249557 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:50.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d1527700 1 --2- 172.21.15.157:0/2480249557 >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 0x7fe3cc0a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d1d28700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 0x7fe3cc135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 -- 172.21.15.157:0/2480249557 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 msgr2=0x7fe3cc135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 0x7fe3cc135c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 -- 172.21.15.157:0/2480249557 >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 msgr2=0x7fe3cc0a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 --2- 172.21.15.157:0/2480249557 >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 0x7fe3cc0a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 -- 172.21.15.157:0/2480249557 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc066d90 con 0x7fe3cc0a7290 2020-07-16T20:30:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d1527700 1 --2- 172.21.15.157:0/2480249557 >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 0x7fe3cc0a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d1d28700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 0x7fe3cc135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.872+0000 7fe3d0d26700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc0a7290 0x7fe3cc0668a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe3cc0a5480 tx=0x7fe3c8007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.873+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800e4a0 con 0x7fe3cc0a7290 2020-07-16T20:30:50.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.873+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800e600 con 0x7fe3cc0a7290 2020-07-16T20:30:50.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.873+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800e960 con 0x7fe3cc0a7290 2020-07-16T20:30:50.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.873+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc136100 con 0x7fe3cc0a7290 2020-07-16T20:30:50.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.873+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc136d80 con 0x7fe3cc0a7290 2020-07-16T20:30:50.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc057490 con 0x7fe3cc0a7290 2020-07-16T20:30:50.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fe3c8019030 con 0x7fe3cc0a7290 2020-07-16T20:30:50.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3b97fa700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 0x7fe3a4052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fe3c80670d0 con 0x7fe3cc0a7290 2020-07-16T20:30:50.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3d1527700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 0x7fe3a4052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.874+0000 7fe3d1527700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 0x7fe3a4052490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe3bc008000 tx=0x7fe3bc009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:50.877+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fe3c803f8d0 con 0x7fe3cc0a7290 2020-07-16T20:30:51.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.079+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe3cc043fd0 con 0x7fe3cc0a7290 2020-07-16T20:30:51.090 INFO:tasks.ceph.mon.b.smithi041.stderr:2020-07-16T20:30:51.080+0000 7fd7f392a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-07-16T20:30:51.091 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.086+0000 7fe3b97fa700 1 -- 172.21.15.157:0/2480249557 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe3c8042ef0 con 0x7fe3cc0a7290 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 msgr2=0x7fe3a4052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 0x7fe3a4052490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe3bc008000 tx=0x7fe3bc009040).stop 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc0a7290 msgr2=0x7fe3cc0668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc0a7290 0x7fe3cc0668a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe3cc0a5480 tx=0x7fe3c8007b70).stop 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 shutdown_connections 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3a404ffd0 0x7fe3a4052490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3cc1345e0 0x7fe3cc135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> v2:172.21.15.41:3300/0 conn(0x7fe3cc0a2ed0 0x7fe3cc0a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 --2- 172.21.15.157:0/2480249557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3cc0a7290 0x7fe3cc0668a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 >> 172.21.15.157:0/2480249557 conn(0x7fe3cc05b810 msgr2=0x7fe3cc132d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.087+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 shutdown_connections 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.088+0000 7fe3d2529700 1 -- 172.21.15.157:0/2480249557 wait complete. 2020-07-16T20:30:51.096 INFO:teuthology.orchestra.run.smithi157.stderr:new fs with metadata pool 3 and data pool 4 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:51.211 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.209+0000 7f2be27c8700 1 Processor -- start 2020-07-16T20:30:51.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.209+0000 7f2be27c8700 1 -- start start 2020-07-16T20:30:51.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be27c8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be27c8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0a5450 con 0x7f2bdc0a7fb0 2020-07-16T20:30:51.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be27c8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0a7880 con 0x7f2bdc0a8420 2020-07-16T20:30:51.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be27c8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0ac5a0 con 0x7f2bdc0a48e0 2020-07-16T20:30:51.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be0d65700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2bdc0a8420 0x7f2bdc0abe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36336/0 (socket says 172.21.15.157:36336) 2020-07-16T20:30:51.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33650/0 (socket says 172.21.15.157:33650) 2020-07-16T20:30:51.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2be0d65700 1 -- 172.21.15.157:0/1130032001 learned_addr learned my addr 172.21.15.157:0/1130032001 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdbfff700 1 -- 172.21.15.157:0/1130032001 >> v1:172.21.15.157:6789/0 conn(0x7f2bdc0a8420 legacy=0x7f2bdc0abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdbfff700 1 -- 172.21.15.157:0/1130032001 >> v1:172.21.15.41:6789/0 conn(0x7f2bdc0a7fb0 legacy=0x7f2bdc0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdaffd700 1 -- 172.21.15.157:0/1130032001 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313248828 0 0) 0x7f2bdc0a7880 con 0x7f2bdc0a8420 2020-07-16T20:30:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.210+0000 7f2bdbfff700 1 -- 172.21.15.157:0/1130032001 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0a56b0 con 0x7f2bdc0a48e0 2020-07-16T20:30:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2bdbfff700 1 --2- 172.21.15.157:0/1130032001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2bcc002f30 tx=0x7f2bcc006dd0).ready entity=mon.1 client_cookie=21c707a31c714410 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2bdaffd700 1 -- 172.21.15.157:0/1130032001 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc0097f0 con 0x7f2bdc0a48e0 2020-07-16T20:30:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2bdaffd700 1 -- 172.21.15.157:0/1130032001 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc009950 con 0x7f2bdc0a48e0 2020-07-16T20:30:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2bdaffd700 1 -- 172.21.15.157:0/1130032001 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc009cb0 con 0x7f2bdc0a48e0 2020-07-16T20:30:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 -- 172.21.15.157:0/1130032001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc0a48e0 msgr2=0x7f2bdc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 --2- 172.21.15.157:0/1130032001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2bcc002f30 tx=0x7f2bcc006dd0).stop 2020-07-16T20:30:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 -- 172.21.15.157:0/1130032001 shutdown_connections 2020-07-16T20:30:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 --2- 172.21.15.157:0/1130032001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc0a48e0 0x7f2bdc0a4cc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 -- 172.21.15.157:0/1130032001 >> 172.21.15.157:0/1130032001 conn(0x7f2bdc061820 msgr2=0x7f2bdc09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 -- 172.21.15.157:0/1130032001 shutdown_connections 2020-07-16T20:30:51.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.211+0000 7f2be27c8700 1 -- 172.21.15.157:0/1130032001 wait complete. 2020-07-16T20:30:51.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.212+0000 7f2be27c8700 1 Processor -- start 2020-07-16T20:30:51.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.212+0000 7f2be27c8700 1 -- start start 2020-07-16T20:30:51.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be27c8700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 0x7f2bdc09f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be27c8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc138060 0x7f2bdc14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be27c8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc135fc0 con 0x7f2bdc0a8420 2020-07-16T20:30:51.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be27c8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc139030 con 0x7f2bdc138060 2020-07-16T20:30:51.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be27c8700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1392d0 con 0x7f2bdc0a7fb0 2020-07-16T20:30:51.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc138060 0x7f2bdc14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2bdc138060 0x7f2bdc14a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33656/0 (socket says 172.21.15.157:33656) 2020-07-16T20:30:51.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 -- 172.21.15.157:0/871567428 learned_addr learned my addr 172.21.15.157:0/871567428 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:51.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2bdbfff700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 0x7f2bdc09f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 -- 172.21.15.157:0/871567428 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 msgr2=0x7f2bdc09f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 0x7f2bdc09f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 -- 172.21.15.157:0/871567428 >> v1:172.21.15.41:6789/0 conn(0x7f2bdc0a8420 legacy=0x7f2bdc12fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 -- 172.21.15.157:0/871567428 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc139570 con 0x7f2bdc138060 2020-07-16T20:30:51.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2bdbfff700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 0x7f2bdc09f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:51.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.213+0000 7f2be0d65700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc138060 0x7f2bdc14a700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2bd4001210 tx=0x7f2bd4007d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.214+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd4005b80 con 0x7f2bdc138060 2020-07-16T20:30:51.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.214+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4005ce0 con 0x7f2bdc138060 2020-07-16T20:30:51.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.214+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc1384d0 con 0x7f2bdc138060 2020-07-16T20:30:51.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.214+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd4004a70 con 0x7f2bdc138060 2020-07-16T20:30:51.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.214+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc138cb0 con 0x7f2bdc138060 2020-07-16T20:30:51.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc139700 con 0x7f2bdc138060 2020-07-16T20:30:51.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2bd401b060 con 0x7f2bdc138060 2020-07-16T20:30:51.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2bbbfff700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 0x7f2bb40523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2bd4067820 con 0x7f2bdc138060 2020-07-16T20:30:51.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2bdbfff700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 0x7f2bb40523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.215+0000 7f2bdbfff700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 0x7f2bb40523e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2bcc01a000 tx=0x7f2bcc015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.231 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.218+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f2bd403ffb0 con 0x7f2bdc138060 2020-07-16T20:30:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.365+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bdc057490 con 0x7f2bdc138060 2020-07-16T20:30:51.395 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.366+0000 7f2bbbfff700 1 -- 172.21.15.157:0/871567428 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f2bd4019030 con 0x7f2bdc138060 2020-07-16T20:30:51.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 msgr2=0x7f2bb40523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.396 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 0x7f2bb40523e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2bcc01a000 tx=0x7f2bcc015000).stop 2020-07-16T20:30:51.397 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc138060 msgr2=0x7f2bdc14a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.397 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc138060 0x7f2bdc14a700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2bd4001210 tx=0x7f2bd4007d20).stop 2020-07-16T20:30:51.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 shutdown_connections 2020-07-16T20:30:51.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2bb404ff20 0x7f2bb40523e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc138060 0x7f2bdc14a700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 --2- 172.21.15.157:0/871567428 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2bdc0a7fb0 0x7f2bdc09f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.367+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 >> 172.21.15.157:0/871567428 conn(0x7f2bdc061820 msgr2=0x7f2bdc05bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.368+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 shutdown_connections 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.368+0000 7f2be27c8700 1 -- 172.21.15.157:0/871567428 wait complete. 2020-07-16T20:30:51.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:51.408 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:51.409 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:51.527 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 Processor -- start 2020-07-16T20:30:51.529 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 -- start start 2020-07-16T20:30:51.529 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 0x7fac300a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.530 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fac30137a40 0x7fac30137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.530 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 0x7fac3013b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.530 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300a5c70 con 0x7fac300a24b0 2020-07-16T20:30:51.531 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac301372f0 con 0x7fac30137a40 2020-07-16T20:30:51.531 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.516+0000 7fac34e93700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300a68a0 con 0x7fac3013aee0 2020-07-16T20:30:51.532 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fac30137a40 0x7fac30137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.532 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fac30137a40 0x7fac30137eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33660/0 (socket says 172.21.15.157:33660) 2020-07-16T20:30:51.532 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 -- 172.21.15.157:0/2461565189 learned_addr learned my addr 172.21.15.157:0/2461565189 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:51.533 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2e59c700 1 --2- 172.21.15.157:0/2461565189 >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 0x7fac300a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.533 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2ed9d700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 0x7fac3013b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.533 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 -- 172.21.15.157:0/2461565189 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 msgr2=0x7fac3013b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.534 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 0x7fac3013b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.534 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 -- 172.21.15.157:0/2461565189 >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 msgr2=0x7fac300a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.534 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 --2- 172.21.15.157:0/2461565189 >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 0x7fac300a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.534 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 -- 172.21.15.157:0/2461565189 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3013aa40 con 0x7fac30137a40 2020-07-16T20:30:51.535 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2e59c700 1 --2- 172.21.15.157:0/2461565189 >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 0x7fac300a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:51.540 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2ed9d700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 0x7fac3013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:51.540 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2dd9b700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac30137a40 0x7fac30137eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fac18002f30 tx=0x7fac18006e90).ready entity=mon.1 client_cookie=5e6bc58bf13f25eb server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2d59a700 1 -- 172.21.15.157:0/2461565189 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac18009920 con 0x7fac30137a40 2020-07-16T20:30:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2d59a700 1 -- 172.21.15.157:0/2461565189 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac18009a80 con 0x7fac30137a40 2020-07-16T20:30:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac2d59a700 1 -- 172.21.15.157:0/2461565189 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac18009de0 con 0x7fac30137a40 2020-07-16T20:30:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 -- 172.21.15.157:0/2461565189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac30137a40 msgr2=0x7fac30137eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.542 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac30137a40 0x7fac30137eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fac18002f30 tx=0x7fac18006e90).stop 2020-07-16T20:30:51.542 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 -- 172.21.15.157:0/2461565189 shutdown_connections 2020-07-16T20:30:51.542 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac3013aee0 0x7fac3013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.542 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 --2- 172.21.15.157:0/2461565189 >> v2:172.21.15.41:3300/0 conn(0x7fac300a24b0 0x7fac300a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.543 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 --2- 172.21.15.157:0/2461565189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac30137a40 0x7fac30137eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.543 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 -- 172.21.15.157:0/2461565189 >> 172.21.15.157:0/2461565189 conn(0x7fac30061820 msgr2=0x7fac3009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.543 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 -- 172.21.15.157:0/2461565189 shutdown_connections 2020-07-16T20:30:51.544 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.517+0000 7fac34e93700 1 -- 172.21.15.157:0/2461565189 wait complete. 2020-07-16T20:30:51.544 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.519+0000 7fac34e93700 1 Processor -- start 2020-07-16T20:30:51.544 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.519+0000 7fac34e93700 1 -- start start 2020-07-16T20:30:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac34e93700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 0x7fac300a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.550 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac34e93700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300a3c70 con 0x7fac3013aee0 2020-07-16T20:30:51.550 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac34e93700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300a3f10 con 0x7fac300a24b0 2020-07-16T20:30:51.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac34e93700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3009f600 con 0x7fac300a37d0 2020-07-16T20:30:51.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac2dd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fac3013aee0 0x7fac30130d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:49930/0 (socket says 172.21.15.157:49930) 2020-07-16T20:30:51.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac2dd9b700 1 -- 172.21.15.157:0/916469405 learned_addr learned my addr 172.21.15.157:0/916469405 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:51.551 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac2ed9d700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 0x7fac300a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730799671 0 0) 0x7fac300a3c70 con 0x7fac3013aee0 2020-07-16T20:30:51.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c003240 con 0x7fac3013aee0 2020-07-16T20:30:51.552 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035056464 0 0) 0x7fac300a3f10 con 0x7fac300a24b0 2020-07-16T20:30:51.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.520+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac300a3c70 con 0x7fac300a24b0 2020-07-16T20:30:51.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac2ed9d700 1 -- 172.21.15.157:0/916469405 >> v1:172.21.15.157:6789/0 conn(0x7fac300a24b0 legacy=0x7fac300a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.553 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac2ed9d700 1 -- 172.21.15.157:0/916469405 >> v1:172.21.15.41:6789/0 conn(0x7fac3013aee0 legacy=0x7fac30130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.559 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac2ed9d700 1 -- 172.21.15.157:0/916469405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30131480 con 0x7fac300a37d0 2020-07-16T20:30:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac2ed9d700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 0x7fac300a4210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fac2000a000 tx=0x7fac20008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000f880 con 0x7fac300a37d0 2020-07-16T20:30:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac30139a90 con 0x7fac300a37d0 2020-07-16T20:30:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000f9e0 con 0x7fac300a37d0 2020-07-16T20:30:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000fd40 con 0x7fac300a37d0 2020-07-16T20:30:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.521+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3009faa0 con 0x7fac300a37d0 2020-07-16T20:30:51.564 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.522+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac30057490 con 0x7fac300a37d0 2020-07-16T20:30:51.565 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.522+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fac200123e0 con 0x7fac300a37d0 2020-07-16T20:30:51.566 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.522+0000 7fac267fc700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 0x7fac0c052960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.566 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.522+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fac20067830 con 0x7fac300a37d0 2020-07-16T20:30:51.567 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.522+0000 7fac2e59c700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 0x7fac0c052960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.567 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.523+0000 7fac2e59c700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 0x7fac0c052960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fac28007000 tx=0x7fac28008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.568 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.526+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fac2003fee0 con 0x7fac300a37d0 2020-07-16T20:30:51.676 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.674+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac30043fd0 con 0x7fac300a37d0 2020-07-16T20:30:51.677 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.676+0000 7fac267fc700 1 -- 172.21.15.157:0/916469405 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fac20043500 con 0x7fac300a37d0 2020-07-16T20:30:51.678 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:51.678 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:51.680 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 msgr2=0x7fac0c052960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.680 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 0x7fac0c052960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fac28007000 tx=0x7fac28008040).stop 2020-07-16T20:30:51.680 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 msgr2=0x7fac300a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.681 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 0x7fac300a4210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fac2000a000 tx=0x7fac20008040).stop 2020-07-16T20:30:51.681 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 shutdown_connections 2020-07-16T20:30:51.681 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fac0c0504a0 0x7fac0c052960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.681 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 --2- 172.21.15.157:0/916469405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fac300a37d0 0x7fac300a4210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.682 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 >> 172.21.15.157:0/916469405 conn(0x7fac30061820 msgr2=0x7fac300abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.682 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 shutdown_connections 2020-07-16T20:30:51.682 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.677+0000 7fac34e93700 1 -- 172.21.15.157:0/916469405 wait complete. 2020-07-16T20:30:51.689 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-07-16T20:30:51.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.797+0000 7f0c37f1f700 1 Processor -- start 2020-07-16T20:30:51.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c37f1f700 1 -- start start 2020-07-16T20:30:51.807 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c37f1f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c300ac2b0 0x7f0c300a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.808 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c37f1f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300a4a40 con 0x7f0c3013e2a0 2020-07-16T20:30:51.808 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c37f1f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c30133410 con 0x7f0c30132870 2020-07-16T20:30:51.808 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c37f1f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c300ac690 con 0x7f0c300ac2b0 2020-07-16T20:30:51.809 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c35cbb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c300ac2b0 0x7f0c300a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.809 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c35cbb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c300ac2b0 0x7f0c300a70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33672/0 (socket says 172.21.15.157:33672) 2020-07-16T20:30:51.809 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c354ba700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0c30132870 0x7f0c30132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36360/0 (socket says 172.21.15.157:36360) 2020-07-16T20:30:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.798+0000 7f0c35cbb700 1 -- 172.21.15.157:0/1680954154 learned_addr learned my addr 172.21.15.157:0/1680954154 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c35cbb700 1 -- 172.21.15.157:0/1680954154 >> v1:172.21.15.157:6789/0 conn(0x7f0c30132870 legacy=0x7f0c30132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c35cbb700 1 -- 172.21.15.157:0/1680954154 >> v1:172.21.15.41:6789/0 conn(0x7f0c3013e2a0 legacy=0x7f0c30140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c35cbb700 1 -- 172.21.15.157:0/1680954154 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300a7590 con 0x7f0c300ac2b0 2020-07-16T20:30:51.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c35cbb700 1 --2- 172.21.15.157:0/1680954154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c300ac2b0 0x7f0c300a70a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0c20002f30 tx=0x7f0c20006f20).ready entity=mon.1 client_cookie=79e48bdb2fa3853a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c34cb9700 1 -- 172.21.15.157:0/1680954154 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c2000cc40 con 0x7f0c300ac2b0 2020-07-16T20:30:51.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c34cb9700 1 -- 172.21.15.157:0/1680954154 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2000cda0 con 0x7f0c300ac2b0 2020-07-16T20:30:51.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c34cb9700 1 -- 172.21.15.157:0/1680954154 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c20010600 con 0x7f0c300ac2b0 2020-07-16T20:30:51.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 -- 172.21.15.157:0/1680954154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c300ac2b0 msgr2=0x7f0c300a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 --2- 172.21.15.157:0/1680954154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c300ac2b0 0x7f0c300a70a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0c20002f30 tx=0x7f0c20006f20).stop 2020-07-16T20:30:51.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 -- 172.21.15.157:0/1680954154 shutdown_connections 2020-07-16T20:30:51.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 --2- 172.21.15.157:0/1680954154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c300ac2b0 0x7f0c300a70a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 -- 172.21.15.157:0/1680954154 >> 172.21.15.157:0/1680954154 conn(0x7f0c3009e7e0 msgr2=0x7f0c3009ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 -- 172.21.15.157:0/1680954154 shutdown_connections 2020-07-16T20:30:51.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.799+0000 7f0c37f1f700 1 -- 172.21.15.157:0/1680954154 wait complete. 2020-07-16T20:30:51.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.800+0000 7f0c37f1f700 1 Processor -- start 2020-07-16T20:30:51.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.800+0000 7f0c37f1f700 1 -- start start 2020-07-16T20:30:51.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c37f1f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0c3013e2a0 0x7f0c30066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c37f1f700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c3012e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c37f1f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c301304d0 con 0x7f0c30132870 2020-07-16T20:30:51.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c37f1f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3012f360 con 0x7f0c3013e2a0 2020-07-16T20:30:51.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c37f1f700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3012f600 con 0x7f0c30136d40 2020-07-16T20:30:51.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c35cbb700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0c30132870 0x7f0c3012d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36366/0 (socket says 172.21.15.157:36366) 2020-07-16T20:30:51.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c35cbb700 1 -- 172.21.15.157:0/3376265802 learned_addr learned my addr 172.21.15.157:0/3376265802 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:51.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471135112 0 0) 0x7f0c301304d0 con 0x7f0c30132870 2020-07-16T20:30:51.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c08003240 con 0x7f0c30132870 2020-07-16T20:30:51.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c354ba700 1 --2- 172.21.15.157:0/3376265802 >> v2:172.21.15.41:3300/0 conn(0x7f0c3013e2a0 0x7f0c30066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c364bc700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c3012e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 153099922 0 0) 0x7f0c08003240 con 0x7f0c30132870 2020-07-16T20:30:51.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c301304d0 con 0x7f0c30132870 2020-07-16T20:30:51.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f0c2000ca50 con 0x7f0c30132870 2020-07-16T20:30:51.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 msgr2=0x7f0c3012e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c3012e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 >> v2:172.21.15.41:3300/0 conn(0x7f0c3013e2a0 msgr2=0x7f0c30066560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> v2:172.21.15.41:3300/0 conn(0x7f0c3013e2a0 0x7f0c30066560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.801+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 >> v1:172.21.15.157:6789/0 conn(0x7f0c30132870 legacy=0x7f0c3012d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c08003800 0x7f0c08003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c080044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0c080049d0 0x7f0c08004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3012f360 con 0x7f0c080049d0 2020-07-16T20:30:51.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3012f600 con 0x7f0c08003800 2020-07-16T20:30:51.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08004260 con 0x7f0c30136d40 2020-07-16T20:30:51.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c08003800 0x7f0c08003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.824 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c354ba700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c080044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c364bc700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0c080049d0 0x7f0c08004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 -- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 msgr2=0x7f0c080044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.825 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f0c30136d40 0x7f0c080044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 -- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0c080049d0 msgr2=0x7f0c08004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0c080049d0 0x7f0c08004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30130150 con 0x7f0c08003800 2020-07-16T20:30:51.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c30067ef0 con 0x7f0c08003800 2020-07-16T20:30:51.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c35cbb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c08003800 0x7f0c08003c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0c20000b80 tx=0x7f0c20017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3012e220 con 0x7f0c08003800 2020-07-16T20:30:51.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c20018890 con 0x7f0c08003800 2020-07-16T20:30:51.827 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c200189f0 con 0x7f0c08003800 2020-07-16T20:30:51.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.802+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c20018d50 con 0x7f0c08003800 2020-07-16T20:30:51.828 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.803+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c30057490 con 0x7f0c08003800 2020-07-16T20:30:51.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.803+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0c2002a070 con 0x7f0c08003800 2020-07-16T20:30:51.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.804+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0c080580c0 0x7f0c0805a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.804+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0c2006a2d0 con 0x7f0c08003800 2020-07-16T20:30:51.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.804+0000 7f0c354ba700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0c080580c0 0x7f0c0805a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.804+0000 7f0c354ba700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0c080580c0 0x7f0c0805a580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0c2c005000 tx=0x7f0c2c007b20).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:51.807+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f0c200429e0 con 0x7f0c08003800 2020-07-16T20:30:52.007 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.005+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0c3012f770 con 0x7f0c08003800 2020-07-16T20:30:52.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.735+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3376265802 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c20046000 con 0x7f0c08003800 2020-07-16T20:30:52.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0c080580c0 msgr2=0x7f0c0805a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:52.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0c080580c0 0x7f0c0805a580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0c2c005000 tx=0x7f0c2c007b20).stop 2020-07-16T20:30:52.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c08003800 msgr2=0x7f0c08003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:52.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 --2- 172.21.15.157:0/3376265802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c08003800 0x7f0c08003c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0c20000b80 tx=0x7f0c20017000).stop 2020-07-16T20:30:52.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c364bc700 1 -- 172.21.15.157:0/3376265802 reap_dead start 2020-07-16T20:30:52.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 shutdown_connections 2020-07-16T20:30:52.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 >> 172.21.15.157:0/3376265802 conn(0x7f0c3009e7e0 msgr2=0x7f0c300ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:52.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 shutdown_connections 2020-07-16T20:30:52.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.737+0000 7f0c37f1f700 1 -- 172.21.15.157:0/3376265802 wait complete. 2020-07-16T20:30:52.750 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:30:52.864 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.862+0000 7f26120fc700 1 Processor -- start 2020-07-16T20:30:52.865 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 -- start start 2020-07-16T20:30:52.867 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f260c0a24b0 0x7f260c0a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:52.867 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f260c137eb0 0x7f260c141c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:52.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0a68a0 con 0x7f260c137a40 2020-07-16T20:30:52.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0a5c70 con 0x7f260c137eb0 2020-07-16T20:30:52.868 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f26120fc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c1372f0 con 0x7f260c0a24b0 2020-07-16T20:30:52.869 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f260b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f260c0a24b0 0x7f260c0a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:52.869 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f260b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f260c0a24b0 0x7f260c0a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33692/0 (socket says 172.21.15.157:33692) 2020-07-16T20:30:52.869 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.863+0000 7f260b7fe700 1 -- 172.21.15.157:0/479336248 learned_addr learned my addr 172.21.15.157:0/479336248 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:52.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260b7fe700 1 -- 172.21.15.157:0/479336248 >> v2:172.21.15.41:3300/0 conn(0x7f260c137eb0 msgr2=0x7f260c141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:52.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260b7fe700 1 --2- 172.21.15.157:0/479336248 >> v2:172.21.15.41:3300/0 conn(0x7f260c137eb0 0x7f260c141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:52.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260b7fe700 1 -- 172.21.15.157:0/479336248 >> v1:172.21.15.41:6789/0 conn(0x7f260c137a40 legacy=0x7f260c13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:52.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260b7fe700 1 -- 172.21.15.157:0/479336248 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c13aa40 con 0x7f260c0a24b0 2020-07-16T20:30:52.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260b7fe700 1 --2- 172.21.15.157:0/479336248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f260c0a24b0 0x7f260c0a4e40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f260c0a7d50 tx=0x7f25fc006e90).ready entity=mon.1 client_cookie=7e26c92250261f1 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:52.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260a7fc700 1 -- 172.21.15.157:0/479336248 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc009930 con 0x7f260c0a24b0 2020-07-16T20:30:52.872 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260a7fc700 1 -- 172.21.15.157:0/479336248 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc009a90 con 0x7f260c0a24b0 2020-07-16T20:30:52.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f260a7fc700 1 -- 172.21.15.157:0/479336248 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc009e30 con 0x7f260c0a24b0 2020-07-16T20:30:52.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 -- 172.21.15.157:0/479336248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f260c0a24b0 msgr2=0x7f260c0a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:52.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 --2- 172.21.15.157:0/479336248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f260c0a24b0 0x7f260c0a4e40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f260c0a7d50 tx=0x7f25fc006e90).stop 2020-07-16T20:30:52.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 -- 172.21.15.157:0/479336248 shutdown_connections 2020-07-16T20:30:52.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 --2- 172.21.15.157:0/479336248 >> v2:172.21.15.41:3300/0 conn(0x7f260c137eb0 0x7f260c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:52.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 --2- 172.21.15.157:0/479336248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f260c0a24b0 0x7f260c0a4e40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:52.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 -- 172.21.15.157:0/479336248 >> 172.21.15.157:0/479336248 conn(0x7f260c061820 msgr2=0x7f260c09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:52.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 -- 172.21.15.157:0/479336248 shutdown_connections 2020-07-16T20:30:52.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.864+0000 7f26120fc700 1 -- 172.21.15.157:0/479336248 wait complete. 2020-07-16T20:30:52.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.865+0000 7f26120fc700 1 Processor -- start 2020-07-16T20:30:52.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 -- start start 2020-07-16T20:30:52.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:52.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:52.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0a10e0 con 0x7f260c137eb0 2020-07-16T20:30:52.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0a3b80 con 0x7f260c0a0bb0 2020-07-16T20:30:52.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f26120fc700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0a3d70 con 0x7f260c137a40 2020-07-16T20:30:52.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260b7fe700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:52.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:52.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260b7fe700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:59036/0 (socket says 172.21.15.157:59036) 2020-07-16T20:30:52.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260b7fe700 1 -- 172.21.15.157:0/1189158615 learned_addr learned my addr 172.21.15.157:0/1189158615 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:52.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:58938/0 (socket says 172.21.15.157:58938) 2020-07-16T20:30:52.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.866+0000 7f260affd700 1 --1- 172.21.15.157:0/1189158615 >> v1:172.21.15.41:6789/0 conn(0x7f260c137eb0 0x7f260c1389f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:49962/0 (socket says 172.21.15.157:49962) 2020-07-16T20:30:52.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587968646 0 0) 0x7f260c0a10e0 con 0x7f260c137eb0 2020-07-16T20:30:52.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4003240 con 0x7f260c137eb0 2020-07-16T20:30:52.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260b7fe700 1 -- 172.21.15.157:0/1189158615 >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 msgr2=0x7f260c130da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:52.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260b7fe700 1 --2- 172.21.15.157:0/1189158615 >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:52.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260b7fe700 1 -- 172.21.15.157:0/1189158615 >> v1:172.21.15.41:6789/0 conn(0x7f260c137eb0 legacy=0x7f260c1389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:52.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260b7fe700 1 -- 172.21.15.157:0/1189158615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c067940 con 0x7f260c137a40 2020-07-16T20:30:52.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260bfff700 1 --2- 172.21.15.157:0/1189158615 >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:52.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f260b7fe700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f260c0a7d50 tx=0x7f25fc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:52.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc01e460 con 0x7f260c137a40 2020-07-16T20:30:52.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc01e5c0 con 0x7f260c137a40 2020-07-16T20:30:52.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c0a4aa0 con 0x7f260c137a40 2020-07-16T20:30:52.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc01e920 con 0x7f260c137a40 2020-07-16T20:30:52.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.867+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c0a4450 con 0x7f260c137a40 2020-07-16T20:30:52.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.868+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c057490 con 0x7f260c137a40 2020-07-16T20:30:52.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.868+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f25fc025030 con 0x7f260c137a40 2020-07-16T20:30:52.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.869+0000 7f25eb7fe700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 0x7f25e40527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:52.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.869+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f25fc0694b0 con 0x7f260c137a40 2020-07-16T20:30:52.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.869+0000 7f260affd700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 0x7f25e40527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:52.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.869+0000 7f260affd700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 0x7f25e40527d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2600001060 tx=0x7f2600007810).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:52.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:52.873+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f25fc041bc0 con 0x7f260c137a40 2020-07-16T20:30:53.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.067+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f260c043fd0 con 0x7f260c137a40 2020-07-16T20:30:53.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.068+0000 7f25eb7fe700 1 -- 172.21.15.157:0/1189158615 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1416 (secure 0 0 0) 0x7f25fc0235a0 con 0x7f260c137a40 2020-07-16T20:30:53.070 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:53.071 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:51.081808+0000","modified":"2020-07-16T20:30:52.731085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:30:53.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 msgr2=0x7f25e40527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 0x7f25e40527d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2600001060 tx=0x7f2600007810).stop 2020-07-16T20:30:53.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 msgr2=0x7f260c139f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f260c0a7d50 tx=0x7f25fc015000).stop 2020-07-16T20:30:53.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 shutdown_connections 2020-07-16T20:30:53.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f25e4050310 0x7f25e40527d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 --2- 172.21.15.157:0/1189158615 >> v2:172.21.15.41:3300/0 conn(0x7f260c0a0bb0 0x7f260c130da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 --2- 172.21.15.157:0/1189158615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f260c137a40 0x7f260c139f50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 >> 172.21.15.157:0/1189158615 conn(0x7f260c061820 msgr2=0x7f260c0aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 shutdown_connections 2020-07-16T20:30:53.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.069+0000 7f26120fc700 1 -- 172.21.15.157:0/1189158615 wait complete. 2020-07-16T20:30:53.076 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 3 2020-07-16T20:30:53.082 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:53.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.188+0000 7fc55cc63700 1 Processor -- start 2020-07-16T20:30:53.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.188+0000 7fc55cc63700 1 -- start start 2020-07-16T20:30:53.198 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55cc63700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc5580a48e0 0x7fc5580a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55cc63700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc5580a7fb0 0x7fc5580a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55cc63700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580a5450 con 0x7fc5580ab780 2020-07-16T20:30:53.200 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55cc63700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5580a8950 con 0x7fc5580a7fb0 2020-07-16T20:30:53.200 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55cc63700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580a7880 con 0x7fc5580a48e0 2020-07-16T20:30:53.200 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc555d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc5580a7fb0 0x7fc5580a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc55659c700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc5580a48e0 0x7fc5580a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.202 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc555d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc5580a7fb0 0x7fc5580a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:58946/0 (socket says 172.21.15.157:58946) 2020-07-16T20:30:53.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc555d9b700 1 -- 172.21.15.157:0/3487485146 learned_addr learned my addr 172.21.15.157:0/3487485146 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:53.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.189+0000 7fc556d9d700 1 --1- 172.21.15.157:0/3487485146 >> v1:172.21.15.41:6789/0 conn(0x7fc5580ab780 0x7fc5580abbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:49970/0 (socket says 172.21.15.157:49970) 2020-07-16T20:30:53.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc555d9b700 1 -- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc5580a48e0 msgr2=0x7fc5580a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:53.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc555d9b700 1 --2- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc5580a48e0 0x7fc5580a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc555d9b700 1 -- 172.21.15.157:0/3487485146 >> v1:172.21.15.41:6789/0 conn(0x7fc5580ab780 legacy=0x7fc5580abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55559a700 1 -- 172.21.15.157:0/3487485146 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532984434 0 0) 0x7fc5580a5450 con 0x7fc5580ab780 2020-07-16T20:30:53.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc555d9b700 1 -- 172.21.15.157:0/3487485146 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580a56b0 con 0x7fc5580a7fb0 2020-07-16T20:30:53.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc555d9b700 1 --2- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5580a7fb0 0x7fc5580a8460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc548002f30 tx=0x7fc548006e90).ready entity=mon.0 client_cookie=cb55d67733924475 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.207 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55559a700 1 -- 172.21.15.157:0/3487485146 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc548009850 con 0x7fc5580a7fb0 2020-07-16T20:30:53.207 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55559a700 1 -- 172.21.15.157:0/3487485146 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480099b0 con 0x7fc5580a7fb0 2020-07-16T20:30:53.208 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 -- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5580a7fb0 msgr2=0x7fc5580a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.208 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 --2- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5580a7fb0 0x7fc5580a8460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc548002f30 tx=0x7fc548006e90).stop 2020-07-16T20:30:53.209 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 -- 172.21.15.157:0/3487485146 shutdown_connections 2020-07-16T20:30:53.209 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 --2- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc5580a48e0 0x7fc5580a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.211 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 --2- 172.21.15.157:0/3487485146 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5580a7fb0 0x7fc5580a8460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.211 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 -- 172.21.15.157:0/3487485146 >> 172.21.15.157:0/3487485146 conn(0x7fc558061820 msgr2=0x7fc55809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 -- 172.21.15.157:0/3487485146 shutdown_connections 2020-07-16T20:30:53.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.190+0000 7fc55cc63700 1 -- 172.21.15.157:0/3487485146 wait complete. 2020-07-16T20:30:53.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.191+0000 7fc55cc63700 1 Processor -- start 2020-07-16T20:30:53.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.191+0000 7fc55cc63700 1 -- start start 2020-07-16T20:30:53.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc5580a48e0 0x7fc55812b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5580ab780 0x7fc558147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc55814a7b0 0x7fc558147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc558146d50 con 0x7fc5580a48e0 2020-07-16T20:30:53.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc558147b20 con 0x7fc5580ab780 2020-07-16T20:30:53.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55cc63700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55814acc0 con 0x7fc55814a7b0 2020-07-16T20:30:53.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5580ab780 0x7fc558147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5580ab780 0x7fc558147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33712/0 (socket says 172.21.15.157:33712) 2020-07-16T20:30:53.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 -- 172.21.15.157:0/2420013345 learned_addr learned my addr 172.21.15.157:0/2420013345 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:53.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc55659c700 1 --2- 172.21.15.157:0/2420013345 >> v2:172.21.15.41:3300/0 conn(0x7fc5580a48e0 0x7fc55812b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc556d9d700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc55814a7b0 0x7fc558147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 -- 172.21.15.157:0/2420013345 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc55814a7b0 msgr2=0x7fc558147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc55814a7b0 0x7fc558147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 -- 172.21.15.157:0/2420013345 >> v2:172.21.15.41:3300/0 conn(0x7fc5580a48e0 msgr2=0x7fc55812b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 --2- 172.21.15.157:0/2420013345 >> v2:172.21.15.41:3300/0 conn(0x7fc5580a48e0 0x7fc55812b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.192+0000 7fc555d9b700 1 -- 172.21.15.157:0/2420013345 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55814af60 con 0x7fc5580ab780 2020-07-16T20:30:53.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc555d9b700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580ab780 0x7fc558147140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc548002f30 tx=0x7fc548015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54801e460 con 0x7fc5580ab780 2020-07-16T20:30:53.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54801e5c0 con 0x7fc5580ab780 2020-07-16T20:30:53.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54801e920 con 0x7fc5580ab780 2020-07-16T20:30:53.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5580a6f40 con 0x7fc5580ab780 2020-07-16T20:30:53.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.193+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5581397d0 con 0x7fc5580ab780 2020-07-16T20:30:53.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.194+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc558057490 con 0x7fc5580ab780 2020-07-16T20:30:53.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.194+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fc548025030 con 0x7fc5580ab780 2020-07-16T20:30:53.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.194+0000 7fc5467fc700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 0x7fc52c052400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.194+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc548069470 con 0x7fc5580ab780 2020-07-16T20:30:53.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.194+0000 7fc55659c700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 0x7fc52c052400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.195+0000 7fc55659c700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 0x7fc52c052400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc54c00b000 tx=0x7fc54c006dd0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.198+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fc548041c00 con 0x7fc5580ab780 2020-07-16T20:30:53.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.346+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5580a2c30 con 0x7fc5580ab780 2020-07-16T20:30:53.349 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.347+0000 7fc5467fc700 1 -- 172.21.15.157:0/2420013345 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fc548045220 con 0x7fc5580ab780 2020-07-16T20:30:53.349 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:53.349 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:53.350 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.348+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 msgr2=0x7fc52c052400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.351 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.348+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 0x7fc52c052400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc54c00b000 tx=0x7fc54c006dd0).stop 2020-07-16T20:30:53.351 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580ab780 msgr2=0x7fc558147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.351 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580ab780 0x7fc558147140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc548002f30 tx=0x7fc548015000).stop 2020-07-16T20:30:53.351 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 shutdown_connections 2020-07-16T20:30:53.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc52c04ff40 0x7fc52c052400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc55814a7b0 0x7fc558147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> v2:172.21.15.41:3300/0 conn(0x7fc5580a48e0 0x7fc55812b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 --2- 172.21.15.157:0/2420013345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580ab780 0x7fc558147140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 >> 172.21.15.157:0/2420013345 conn(0x7fc558061820 msgr2=0x7fc55812ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 shutdown_connections 2020-07-16T20:30:53.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.349+0000 7fc55cc63700 1 -- 172.21.15.157:0/2420013345 wait complete. 2020-07-16T20:30:53.361 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-07-16T20:30:53.362 INFO:tasks.ceph.mds.a:Restarting daemon 2020-07-16T20:30:53.362 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-07-16T20:30:53.365 INFO:tasks.ceph.mds.a:Started 2020-07-16T20:30:53.366 INFO:tasks.ceph.mds.b:Restarting daemon 2020-07-16T20:30:53.366 INFO:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-07-16T20:30:53.369 INFO:tasks.ceph.mds.b:Started 2020-07-16T20:30:53.370 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:53.371 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-07-16T20:30:53.441 INFO:tasks.ceph.mds.a.smithi157.stdout:starting mds.a at 2020-07-16T20:30:53.460 INFO:tasks.ceph.mds.b.smithi041.stdout:starting mds.b at 2020-07-16T20:30:53.480 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.479+0000 7f7d58b41700 1 Processor -- start 2020-07-16T20:30:53.481 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.479+0000 7f7d58b41700 1 -- start start 2020-07-16T20:30:53.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.479+0000 7f7d58b41700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7d5413cb00 0x7f7d540a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.479+0000 7f7d58b41700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d540671a0 0x7f7d54143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5405cd90 con 0x7f7d54066d40 2020-07-16T20:30:53.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5405d030 con 0x7f7d540671a0 2020-07-16T20:30:53.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5405d2d0 con 0x7f7d5413cb00 2020-07-16T20:30:53.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d540671a0 0x7f7d54143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d540671a0 0x7f7d54143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33734/0 (socket says 172.21.15.157:33734) 2020-07-16T20:30:53.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 -- 172.21.15.157:0/3033199384 learned_addr learned my addr 172.21.15.157:0/3033199384 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:53.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d5259c700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7d5413cb00 0x7f7d540a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 -- 172.21.15.157:0/3033199384 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7d5413cb00 msgr2=0x7f7d540a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:53.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7d5413cb00 0x7f7d540a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 -- 172.21.15.157:0/3033199384 >> v1:172.21.15.41:6789/0 conn(0x7f7d54066d40 legacy=0x7f7d5413d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:53.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 -- 172.21.15.157:0/3033199384 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5413cee0 con 0x7f7d540671a0 2020-07-16T20:30:53.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d52d9d700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d540671a0 0x7f7d54143ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7d540a3a40 tx=0x7f7d4c009270).ready entity=mon.1 client_cookie=690d704f3e5c97d6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d5159a700 1 -- 172.21.15.157:0/3033199384 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c00bbc0 con 0x7f7d540671a0 2020-07-16T20:30:53.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d5159a700 1 -- 172.21.15.157:0/3033199384 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c00bd20 con 0x7f7d540671a0 2020-07-16T20:30:53.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d5159a700 1 -- 172.21.15.157:0/3033199384 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c011400 con 0x7f7d540671a0 2020-07-16T20:30:53.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- 172.21.15.157:0/3033199384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d540671a0 msgr2=0x7f7d54143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d540671a0 0x7f7d54143ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7d540a3a40 tx=0x7f7d4c009270).stop 2020-07-16T20:30:53.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- 172.21.15.157:0/3033199384 shutdown_connections 2020-07-16T20:30:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d540671a0 0x7f7d54143ea0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 --2- 172.21.15.157:0/3033199384 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7d5413cb00 0x7f7d540a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- 172.21.15.157:0/3033199384 >> 172.21.15.157:0/3033199384 conn(0x7f7d540600e0 msgr2=0x7f7d54066630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- 172.21.15.157:0/3033199384 shutdown_connections 2020-07-16T20:30:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.480+0000 7f7d58b41700 1 -- 172.21.15.157:0/3033199384 wait complete. 2020-07-16T20:30:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 Processor -- start 2020-07-16T20:30:53.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 -- start start 2020-07-16T20:30:53.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d54066d40 0x7f7d540a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7d5413cb00 0x7f7d54133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d540a4660 con 0x7f7d5413e660 2020-07-16T20:30:53.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d540a4890 con 0x7f7d5413cb00 2020-07-16T20:30:53.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d58b41700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d540a4b30 con 0x7f7d54066d40 2020-07-16T20:30:53.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d5259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d54066d40 0x7f7d540a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d52d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7d5413e660 0x7f7d5414a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36428/0 (socket says 172.21.15.157:36428) 2020-07-16T20:30:53.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d52d9d700 1 -- 172.21.15.157:0/2442483500 learned_addr learned my addr 172.21.15.157:0/2442483500 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:53.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d5259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d54066d40 0x7f7d540a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33736/0 (socket says 172.21.15.157:33736) 2020-07-16T20:30:53.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.482+0000 7f7d51d9b700 1 --2- 172.21.15.157:0/2442483500 >> v2:172.21.15.41:3300/0 conn(0x7f7d5413cb00 0x7f7d54133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d5259c700 1 -- 172.21.15.157:0/2442483500 >> v2:172.21.15.41:3300/0 conn(0x7f7d5413cb00 msgr2=0x7f7d54133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d5259c700 1 --2- 172.21.15.157:0/2442483500 >> v2:172.21.15.41:3300/0 conn(0x7f7d5413cb00 0x7f7d54133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d5259c700 1 -- 172.21.15.157:0/2442483500 >> v1:172.21.15.157:6789/0 conn(0x7f7d5413e660 legacy=0x7f7d5414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d5259c700 1 -- 172.21.15.157:0/2442483500 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540a4dd0 con 0x7f7d54066d40 2020-07-16T20:30:53.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664695876 0 0) 0x7f7d540a4660 con 0x7f7d5413e660 2020-07-16T20:30:53.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d5259c700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d54066d40 0x7f7d540a5e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7d44007000 tx=0x7f7d44008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4400e570 con 0x7f7d54066d40 2020-07-16T20:30:53.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400c030 con 0x7f7d54066d40 2020-07-16T20:30:53.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5414bb90 con 0x7f7d54066d40 2020-07-16T20:30:53.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4400e8c0 con 0x7f7d54066d40 2020-07-16T20:30:53.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.483+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540a59f0 con 0x7f7d54066d40 2020-07-16T20:30:53.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54057490 con 0x7f7d54066d40 2020-07-16T20:30:53.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7d44019030 con 0x7f7d54066d40 2020-07-16T20:30:53.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d427fc700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 0x7f7d28052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7d440674f0 con 0x7f7d54066d40 2020-07-16T20:30:53.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d51d9b700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 0x7f7d28052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.484+0000 7f7d51d9b700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 0x7f7d28052320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7d4800b000 tx=0x7f7d48009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.487+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f7d4403fcd0 con 0x7f7d54066d40 2020-07-16T20:30:53.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.635+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d540a4f60 con 0x7f7d54066d40 2020-07-16T20:30:53.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.636+0000 7f7d427fc700 1 -- 172.21.15.157:0/2442483500 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f7d440432f0 con 0x7f7d54066d40 2020-07-16T20:30:53.638 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:53.639 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.637+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 msgr2=0x7f7d28052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.637+0000 7f7d58b41700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 0x7f7d28052320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7d4800b000 tx=0x7f7d48009040).stop 2020-07-16T20:30:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.637+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d54066d40 msgr2=0x7f7d540a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.637+0000 7f7d58b41700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d54066d40 0x7f7d540a5e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7d44007000 tx=0x7f7d44008040).stop 2020-07-16T20:30:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 shutdown_connections 2020-07-16T20:30:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7d2804fe60 0x7f7d28052320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 --2- 172.21.15.157:0/2442483500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d54066d40 0x7f7d540a5e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 --2- 172.21.15.157:0/2442483500 >> v2:172.21.15.41:3300/0 conn(0x7f7d5413cb00 0x7f7d54133c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 >> 172.21.15.157:0/2442483500 conn(0x7f7d540600e0 msgr2=0x7f7d5413d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 shutdown_connections 2020-07-16T20:30:53.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.638+0000 7f7d58b41700 1 -- 172.21.15.157:0/2442483500 wait complete. 2020-07-16T20:30:53.650 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:32.588806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:42.750526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:46.151313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:48.751540+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:30:53.651 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:53.767 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.765+0000 7fc3f4534700 1 Processor -- start 2020-07-16T20:30:53.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 -- start start 2020-07-16T20:30:53.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc3ec132870 0x7fc3ec132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0a4a40 con 0x7fc3ec1331c0 2020-07-16T20:30:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0ac690 con 0x7fc3ec0ac2b0 2020-07-16T20:30:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f4534700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0a7590 con 0x7fc3ec132870 2020-07-16T20:30:53.777 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f22d0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f2ad1700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc3ec1331c0 0x7fc3ec0a8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36446/0 (socket says 172.21.15.157:36446) 2020-07-16T20:30:53.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f22d0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33756/0 (socket says 172.21.15.157:33756) 2020-07-16T20:30:53.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.766+0000 7fc3f2ad1700 1 -- 172.21.15.157:0/511581507 learned_addr learned my addr 172.21.15.157:0/511581507 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:53.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f22d0700 1 -- 172.21.15.157:0/511581507 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc3ec132870 msgr2=0x7fc3ec132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:53.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f22d0700 1 --2- 172.21.15.157:0/511581507 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc3ec132870 0x7fc3ec132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:53.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f22d0700 1 -- 172.21.15.157:0/511581507 >> v1:172.21.15.157:6789/0 conn(0x7fc3ec1331c0 legacy=0x7fc3ec0a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.780 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f12ce700 1 -- 172.21.15.157:0/511581507 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728791339 0 0) 0x7fc3ec0a4a40 con 0x7fc3ec1331c0 2020-07-16T20:30:53.780 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f22d0700 1 -- 172.21.15.157:0/511581507 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0a3d80 con 0x7fc3ec0ac2b0 2020-07-16T20:30:53.781 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f22d0700 1 --2- 172.21.15.157:0/511581507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc3ec135970 tx=0x7fc3e8006e60).ready entity=mon.1 client_cookie=a78756a32e772d26 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.781 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f12ce700 1 -- 172.21.15.157:0/511581507 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e8010470 con 0x7fc3ec0ac2b0 2020-07-16T20:30:53.781 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f12ce700 1 -- 172.21.15.157:0/511581507 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80105d0 con 0x7fc3ec0ac2b0 2020-07-16T20:30:53.782 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f12ce700 1 -- 172.21.15.157:0/511581507 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e8010930 con 0x7fc3ec0ac2b0 2020-07-16T20:30:53.782 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 -- 172.21.15.157:0/511581507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0ac2b0 msgr2=0x7fc3ec0a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.782 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 --2- 172.21.15.157:0/511581507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc3ec135970 tx=0x7fc3e8006e60).stop 2020-07-16T20:30:53.783 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 -- 172.21.15.157:0/511581507 shutdown_connections 2020-07-16T20:30:53.783 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 --2- 172.21.15.157:0/511581507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0ac2b0 0x7fc3ec0a70a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.783 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 --2- 172.21.15.157:0/511581507 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc3ec132870 0x7fc3ec132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:53.784 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 -- 172.21.15.157:0/511581507 >> 172.21.15.157:0/511581507 conn(0x7fc3ec09e7e0 msgr2=0x7fc3ec09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.784 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 -- 172.21.15.157:0/511581507 shutdown_connections 2020-07-16T20:30:53.784 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.767+0000 7fc3f4534700 1 -- 172.21.15.157:0/511581507 wait complete. 2020-07-16T20:30:53.785 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.768+0000 7fc3f4534700 1 Processor -- start 2020-07-16T20:30:53.785 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f4534700 1 -- start start 2020-07-16T20:30:53.785 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f4534700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec132870 0x7fc3ec138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.786 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f4534700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec14c590 con 0x7fc3ec13c9e0 2020-07-16T20:30:53.786 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f4534700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0a08f0 con 0x7fc3ec0a0450 2020-07-16T20:30:53.786 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f4534700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0a0b90 con 0x7fc3ec132870 2020-07-16T20:30:53.787 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f22d0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec132870 0x7fc3ec138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.787 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f1acf700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc3ec0a0450 0x7fc3ec1371e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36450/0 (socket says 172.21.15.157:36450) 2020-07-16T20:30:53.787 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f1acf700 1 -- 172.21.15.157:0/293171013 learned_addr learned my addr 172.21.15.157:0/293171013 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:53.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f22d0700 1 -- 172.21.15.157:0/293171013 >> v1:172.21.15.157:6789/0 conn(0x7fc3ec0a0450 legacy=0x7fc3ec1371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f22d0700 1 -- 172.21.15.157:0/293171013 >> v1:172.21.15.41:6789/0 conn(0x7fc3ec13c9e0 legacy=0x7fc3ec14cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538780467 0 0) 0x7fc3ec0a08f0 con 0x7fc3ec0a0450 2020-07-16T20:30:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.769+0000 7fc3f22d0700 1 -- 172.21.15.157:0/293171013 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec136d40 con 0x7fc3ec132870 2020-07-16T20:30:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3f22d0700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec132870 0x7fc3ec138450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc3ec135970 tx=0x7fc3e8006e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e801ac50 con 0x7fc3ec132870 2020-07-16T20:30:53.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e801adb0 con 0x7fc3ec132870 2020-07-16T20:30:53.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e800f5c0 con 0x7fc3ec132870 2020-07-16T20:30:53.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec067840 con 0x7fc3ec132870 2020-07-16T20:30:53.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.770+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec14d290 con 0x7fc3ec132870 2020-07-16T20:30:53.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec13cf00 con 0x7fc3ec132870 2020-07-16T20:30:53.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fc3e800f720 con 0x7fc3ec132870 2020-07-16T20:30:53.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3da7fc700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 0x7fc3c4052230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:53.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc3e8069dc0 con 0x7fc3ec132870 2020-07-16T20:30:53.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3f1acf700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 0x7fc3c4052230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:53.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.771+0000 7fc3f1acf700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 0x7fc3c4052230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc3dc002240 tx=0x7fc3dc0078b0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:53.798 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.774+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fc3e8042550 con 0x7fc3ec132870 2020-07-16T20:30:53.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.921+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc3ec14d480 con 0x7fc3ec132870 2020-07-16T20:30:53.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.921+0000 7fc3da7fc700 1 -- 172.21.15.157:0/293171013 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc3e8014070 con 0x7fc3ec132870 2020-07-16T20:30:53.923 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2020-07-16T20:30:53.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.922+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 msgr2=0x7fc3c4052230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.922+0000 7fc3f4534700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 0x7fc3c4052230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc3dc002240 tx=0x7fc3dc0078b0).stop 2020-07-16T20:30:53.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.922+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec132870 msgr2=0x7fc3ec138450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:53.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.922+0000 7fc3f4534700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec132870 0x7fc3ec138450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc3ec135970 tx=0x7fc3e8006e60).stop 2020-07-16T20:30:53.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 shutdown_connections 2020-07-16T20:30:53.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc3c404fd70 0x7fc3c4052230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 --2- 172.21.15.157:0/293171013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec132870 0x7fc3ec138450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:53.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 >> 172.21.15.157:0/293171013 conn(0x7fc3ec09e7e0 msgr2=0x7fc3ec0a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:53.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 shutdown_connections 2020-07-16T20:30:53.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:53.923+0000 7fc3f4534700 1 -- 172.21.15.157:0/293171013 wait complete. 2020-07-16T20:30:53.935 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:54.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.042+0000 7fec16e0f700 1 Processor -- start 2020-07-16T20:30:54.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.042+0000 7fec16e0f700 1 -- start start 2020-07-16T20:30:54.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec16e0f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec10133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec16e0f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10133860 0x7fec100a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec16e0f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec10133cc0 con 0x7fec100a8800 2020-07-16T20:30:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec16e0f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100a4710 con 0x7fec100a7470 2020-07-16T20:30:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec16e0f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100a5c00 con 0x7fec10133860 2020-07-16T20:30:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10133860 0x7fec100a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10133860 0x7fec100a8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33774/0 (socket says 172.21.15.157:33774) 2020-07-16T20:30:54.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 -- 172.21.15.157:0/3923959027 learned_addr learned my addr 172.21.15.157:0/3923959027 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:54.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec14bab700 1 --2- 172.21.15.157:0/3923959027 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec10133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 -- 172.21.15.157:0/3923959027 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 msgr2=0x7fec10133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 --2- 172.21.15.157:0/3923959027 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec10133370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 -- 172.21.15.157:0/3923959027 >> v1:172.21.15.41:6789/0 conn(0x7fec100a8800 legacy=0x7fec10139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 -- 172.21.15.157:0/3923959027 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100a9110 con 0x7fec10133860 2020-07-16T20:30:54.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0ffff700 1 --2- 172.21.15.157:0/3923959027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10133860 0x7fec100a8310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fec1006bb00 tx=0x7fec04006e90).ready entity=mon.1 client_cookie=17c377f564e3a77e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.043+0000 7fec0f7fe700 1 -- 172.21.15.157:0/3923959027 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec04009930 con 0x7fec10133860 2020-07-16T20:30:54.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec0f7fe700 1 -- 172.21.15.157:0/3923959027 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04009a90 con 0x7fec10133860 2020-07-16T20:30:54.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec0f7fe700 1 -- 172.21.15.157:0/3923959027 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec04009e30 con 0x7fec10133860 2020-07-16T20:30:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 -- 172.21.15.157:0/3923959027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10133860 msgr2=0x7fec100a8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3923959027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10133860 0x7fec100a8310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fec1006bb00 tx=0x7fec04006e90).stop 2020-07-16T20:30:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 -- 172.21.15.157:0/3923959027 shutdown_connections 2020-07-16T20:30:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3923959027 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec10133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3923959027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10133860 0x7fec100a8310 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 -- 172.21.15.157:0/3923959027 >> 172.21.15.157:0/3923959027 conn(0x7fec1009e7e0 msgr2=0x7fec1009ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 -- 172.21.15.157:0/3923959027 shutdown_connections 2020-07-16T20:30:54.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.044+0000 7fec16e0f700 1 -- 172.21.15.157:0/3923959027 wait complete. 2020-07-16T20:30:54.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.045+0000 7fec16e0f700 1 Processor -- start 2020-07-16T20:30:54.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.045+0000 7fec16e0f700 1 -- start start 2020-07-16T20:30:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec100abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10129d10 0x7fec1012a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1009f6b0 con 0x7fec100a8800 2020-07-16T20:30:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1012a660 con 0x7fec100a7470 2020-07-16T20:30:54.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1009f950 con 0x7fec10129d10 2020-07-16T20:30:54.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10129d10 0x7fec1012a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec10129d10 0x7fec1012a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33780/0 (socket says 172.21.15.157:33780) 2020-07-16T20:30:54.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 -- 172.21.15.157:0/3456650069 learned_addr learned my addr 172.21.15.157:0/3456650069 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:54.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec14bab700 1 --2- 172.21.15.157:0/3456650069 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec100abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 -- 172.21.15.157:0/3456650069 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 msgr2=0x7fec100abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 --2- 172.21.15.157:0/3456650069 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec100abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 -- 172.21.15.157:0/3456650069 >> v1:172.21.15.41:6789/0 conn(0x7fec100a8800 legacy=0x7fec101384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 -- 172.21.15.157:0/3456650069 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1009fbf0 con 0x7fec10129d10 2020-07-16T20:30:54.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec153ac700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10129d10 0x7fec1012a170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fec080022d0 tx=0x7fec08007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800a7b0 con 0x7fec10129d10 2020-07-16T20:30:54.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800a910 con 0x7fec10129d10 2020-07-16T20:30:54.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec10133140 con 0x7fec10129d10 2020-07-16T20:30:54.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800ac70 con 0x7fec10129d10 2020-07-16T20:30:54.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.046+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101379f0 con 0x7fec10129d10 2020-07-16T20:30:54.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.047+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fec08019030 con 0x7fec10129d10 2020-07-16T20:30:54.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.047+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10137670 con 0x7fec10129d10 2020-07-16T20:30:54.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.048+0000 7fec0cff9700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 0x7febe80523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.048+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fec08067500 con 0x7fec10129d10 2020-07-16T20:30:54.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.048+0000 7fec14bab700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 0x7febe80523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.063 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.048+0000 7fec14bab700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 0x7febe80523f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec0000b000 tx=0x7fec00008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.063 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.051+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fec0803fcc0 con 0x7fec10129d10 2020-07-16T20:30:54.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.199+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec10057490 con 0x7fec10129d10 2020-07-16T20:30:54.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.199+0000 7fec0cff9700 1 -- 172.21.15.157:0/3456650069 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec08017020 con 0x7fec10129d10 2020-07-16T20:30:54.202 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:30:54.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 msgr2=0x7febe80523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 0x7febe80523f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fec0000b000 tx=0x7fec00008040).stop 2020-07-16T20:30:54.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10129d10 msgr2=0x7fec1012a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10129d10 0x7fec1012a170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fec080022d0 tx=0x7fec08007f00).stop 2020-07-16T20:30:54.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 shutdown_connections 2020-07-16T20:30:54.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7febe804ff30 0x7febe80523f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3456650069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec10129d10 0x7fec1012a170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 --2- 172.21.15.157:0/3456650069 >> v2:172.21.15.41:3300/0 conn(0x7fec100a7470 0x7fec100abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 >> 172.21.15.157:0/3456650069 conn(0x7fec1009e7e0 msgr2=0x7fec10130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 shutdown_connections 2020-07-16T20:30:54.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.201+0000 7fec16e0f700 1 -- 172.21.15.157:0/3456650069 wait complete. 2020-07-16T20:30:54.213 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:30:54.322 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.320+0000 7f99005dd700 1 Processor -- start 2020-07-16T20:30:54.322 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.320+0000 7f99005dd700 1 -- start start 2020-07-16T20:30:54.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f99005dd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98f80a70c0 0x7f98f80ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f99005dd700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8136770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f99005dd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f80b00d0 con 0x7f98f80a74a0 2020-07-16T20:30:54.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f99005dd700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f805b810 con 0x7f98f80a70c0 2020-07-16T20:30:54.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f99005dd700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f805bab0 con 0x7f98f80abea0 2020-07-16T20:30:54.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98f80a70c0 0x7f98f80ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98f80a70c0 0x7f98f80ab9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33784/0 (socket says 172.21.15.157:33784) 2020-07-16T20:30:54.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 -- 172.21.15.157:0/2221940646 learned_addr learned my addr 172.21.15.157:0/2221940646 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:54.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98feb7a700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8136770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 -- 172.21.15.157:0/2221940646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 msgr2=0x7f98f8136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8136770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 -- 172.21.15.157:0/2221940646 >> v1:172.21.15.41:6789/0 conn(0x7f98f80a74a0 legacy=0x7f98f8136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 -- 172.21.15.157:0/2221940646 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f805bd50 con 0x7f98f80a70c0 2020-07-16T20:30:54.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.321+0000 7f98fe379700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98f80a70c0 0x7f98f80ab9b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f98f80617c0 tx=0x7f98e8006e90).ready entity=mon.1 client_cookie=33691be025a666c8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f98fd377700 1 -- 172.21.15.157:0/2221940646 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e80098e0 con 0x7f98f80a70c0 2020-07-16T20:30:54.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f98fd377700 1 -- 172.21.15.157:0/2221940646 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8009a40 con 0x7f98f80a70c0 2020-07-16T20:30:54.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f98fd377700 1 -- 172.21.15.157:0/2221940646 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e8009de0 con 0x7f98f80a70c0 2020-07-16T20:30:54.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 -- 172.21.15.157:0/2221940646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98f80a70c0 msgr2=0x7f98f80ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98f80a70c0 0x7f98f80ab9b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f98f80617c0 tx=0x7f98e8006e90).stop 2020-07-16T20:30:54.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 -- 172.21.15.157:0/2221940646 shutdown_connections 2020-07-16T20:30:54.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8136770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 --2- 172.21.15.157:0/2221940646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98f80a70c0 0x7f98f80ab9b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 -- 172.21.15.157:0/2221940646 >> 172.21.15.157:0/2221940646 conn(0x7f98f80ac6a0 msgr2=0x7f98f80acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 -- 172.21.15.157:0/2221940646 shutdown_connections 2020-07-16T20:30:54.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.322+0000 7f99005dd700 1 -- 172.21.15.157:0/2221940646 wait complete. 2020-07-16T20:30:54.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.323+0000 7f99005dd700 1 Processor -- start 2020-07-16T20:30:54.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.323+0000 7f99005dd700 1 -- start start 2020-07-16T20:30:54.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f99005dd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 0x7f98f813cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f99005dd700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f99005dd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f814ca00 con 0x7f98f8135b30 2020-07-16T20:30:54.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f99005dd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f814cca0 con 0x7f98f80a74a0 2020-07-16T20:30:54.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f99005dd700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f814c450 con 0x7f98f80abea0 2020-07-16T20:30:54.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fe379700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 0x7f98f813cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98feb7a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f98f8135b30 0x7f98f8139ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50056/0 (socket says 172.21.15.157:50056) 2020-07-16T20:30:54.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:59130/0 (socket says 172.21.15.157:59130) 2020-07-16T20:30:54.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98feb7a700 1 -- 172.21.15.157:0/826760675 learned_addr learned my addr 172.21.15.157:0/826760675 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:54.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94479764 0 0) 0x7f98f814ca00 con 0x7f98f8135b30 2020-07-16T20:30:54.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d0003240 con 0x7f98f8135b30 2020-07-16T20:30:54.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 -- 172.21.15.157:0/826760675 >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 msgr2=0x7f98f813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 --2- 172.21.15.157:0/826760675 >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 0x7f98f813cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 -- 172.21.15.157:0/826760675 >> v1:172.21.15.41:6789/0 conn(0x7f98f8135b30 legacy=0x7f98f8139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fdb78700 1 -- 172.21.15.157:0/826760675 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f813d190 con 0x7f98f80abea0 2020-07-16T20:30:54.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.324+0000 7f98fe379700 1 --2- 172.21.15.157:0/826760675 >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 0x7f98f813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f98fdb78700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f98f4001f50 tx=0x7f98f4007b50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f4013410 con 0x7f98f80abea0 2020-07-16T20:30:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4013570 con 0x7f98f80abea0 2020-07-16T20:30:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f8149370 con 0x7f98f80abea0 2020-07-16T20:30:54.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f40138d0 con 0x7f98f80abea0 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.325+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f813a470 con 0x7f98f80abea0 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f98f4010030 con 0x7f98f80abea0 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f814c5c0 con 0x7f98f80abea0 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f98e67fc700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 0x7f98d0052840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f98f40678f0 con 0x7f98f80abea0 2020-07-16T20:30:54.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f98fe379700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 0x7f98d0052840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.326+0000 7f98fe379700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 0x7f98d0052840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f98e801c000 tx=0x7f98e8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.330+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f98f814c5c0 con 0x7f98f80abea0 2020-07-16T20:30:54.481 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.479+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98f814c590 con 0x7f98f80abea0 2020-07-16T20:30:54.481 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.480+0000 7f98e67fc700 1 -- 172.21.15.157:0/826760675 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f98f4040080 con 0x7f98f80abea0 2020-07-16T20:30:54.482 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:30:54.483 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 msgr2=0x7f98d0052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.483 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 0x7f98d0052840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f98e801c000 tx=0x7f98e8015000).stop 2020-07-16T20:30:54.483 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 msgr2=0x7f98f8148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f98f4001f50 tx=0x7f98f4007b50).stop 2020-07-16T20:30:54.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 shutdown_connections 2020-07-16T20:30:54.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98d0050380 0x7f98d0052840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 --2- 172.21.15.157:0/826760675 >> v2:172.21.15.41:3300/0 conn(0x7f98f80a74a0 0x7f98f813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 --2- 172.21.15.157:0/826760675 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98f80abea0 0x7f98f8148e80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 >> 172.21.15.157:0/826760675 conn(0x7f98f80ac6a0 msgr2=0x7f98f8136700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 shutdown_connections 2020-07-16T20:30:54.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.481+0000 7f99005dd700 1 -- 172.21.15.157:0/826760675 wait complete. 2020-07-16T20:30:54.493 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:30:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.601+0000 7f2023ca6700 1 Processor -- start 2020-07-16T20:30:54.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.601+0000 7f2023ca6700 1 -- start start 2020-07-16T20:30:54.614 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2023ca6700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f201c0a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.615 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2023ca6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f201c13e2a0 0x7f201c140690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.615 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2023ca6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0a4a40 con 0x7f201c0ac2b0 2020-07-16T20:30:54.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2023ca6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0ac690 con 0x7f201c13e2a0 2020-07-16T20:30:54.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2023ca6700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1333e0 con 0x7f201c132f80 2020-07-16T20:30:54.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2021a42700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f201c0ac2b0 0x7f201c132870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36484/0 (socket says 172.21.15.157:36484) 2020-07-16T20:30:54.617 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2021a42700 1 -- 172.21.15.157:0/4052603753 learned_addr learned my addr 172.21.15.157:0/4052603753 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:54.617 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2021241700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f201c0a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2022243700 1 --2- 172.21.15.157:0/4052603753 >> v2:172.21.15.41:3300/0 conn(0x7f201c13e2a0 0x7f201c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300878136 0 0) 0x7f201c0a4a40 con 0x7f201c0ac2b0 2020-07-16T20:30:54.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2004004350 con 0x7f201c0ac2b0 2020-07-16T20:30:54.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 574623534 0 0) 0x7f2004004350 con 0x7f201c0ac2b0 2020-07-16T20:30:54.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 msgr2=0x7f201c0a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f201c0a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 >> v2:172.21.15.41:3300/0 conn(0x7f201c13e2a0 msgr2=0x7f201c140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 --2- 172.21.15.157:0/4052603753 >> v2:172.21.15.41:3300/0 conn(0x7f201c13e2a0 0x7f201c140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0a7590 con 0x7f201c0ac2b0 2020-07-16T20:30:54.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.602+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f200c0016d0 con 0x7f201c0ac2b0 2020-07-16T20:30:54.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 >> v1:172.21.15.157:6789/0 conn(0x7f201c0ac2b0 legacy=0x7f201c132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2004004840 0x7f2004004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20040055f0 0x7f2004005a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f2004005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0ac690 con 0x7f20040055f0 2020-07-16T20:30:54.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1333e0 con 0x7f2004004840 2020-07-16T20:30:54.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2004005380 con 0x7f201c132f80 2020-07-16T20:30:54.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2004004840 0x7f2004004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021241700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20040055f0 0x7f2004005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2022243700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f2004005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 -- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 msgr2=0x7f2004005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c132f80 0x7f2004005f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 -- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20040055f0 msgr2=0x7f2004005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20040055f0 0x7f2004005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 -- 172.21.15.157:0/4052603753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004004350 con 0x7f2004004840 2020-07-16T20:30:54.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021241700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20040055f0 0x7f2004005a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:54.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2021a42700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2004004840 0x7f2004004c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f201c135970 tx=0x7f200c007750).ready entity=mon.1 client_cookie=8814b6006f2134c6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200c00ce00 con 0x7f2004004840 2020-07-16T20:30:54.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0072e0 con 0x7f2004004840 2020-07-16T20:30:54.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2020a40700 1 -- 172.21.15.157:0/4052603753 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200c0057e0 con 0x7f2004004840 2020-07-16T20:30:54.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 -- 172.21.15.157:0/4052603753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2004004840 msgr2=0x7f2004004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 --2- 172.21.15.157:0/4052603753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2004004840 0x7f2004004c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f201c135970 tx=0x7f200c007750).stop 2020-07-16T20:30:54.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2022243700 1 -- 172.21.15.157:0/4052603753 reap_dead start 2020-07-16T20:30:54.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 -- 172.21.15.157:0/4052603753 shutdown_connections 2020-07-16T20:30:54.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 -- 172.21.15.157:0/4052603753 >> 172.21.15.157:0/4052603753 conn(0x7f201c09e7e0 msgr2=0x7f201c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 -- 172.21.15.157:0/4052603753 shutdown_connections 2020-07-16T20:30:54.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.603+0000 7f2023ca6700 1 -- 172.21.15.157:0/4052603753 wait complete. 2020-07-16T20:30:54.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 Processor -- start 2020-07-16T20:30:54.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 -- start start 2020-07-16T20:30:54.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f201c12aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c133af0 con 0x7f201c134b50 2020-07-16T20:30:54.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c12aef0 con 0x7f201c134460 2020-07-16T20:30:54.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2023ca6700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c129450 con 0x7f201c129010 2020-07-16T20:30:54.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2021241700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f201c134460 0x7f201c128900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36496/0 (socket says 172.21.15.157:36496) 2020-07-16T20:30:54.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.605+0000 7f2021241700 1 -- 172.21.15.157:0/2679092999 learned_addr learned my addr 172.21.15.157:0/2679092999 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:54.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f201c12aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743544828 0 0) 0x7f2018006760 con 0x7f201c134460 2020-07-16T20:30:54.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff4003240 con 0x7f201c134460 2020-07-16T20:30:54.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265620222 0 0) 0x7f201c133af0 con 0x7f201c134b50 2020-07-16T20:30:54.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2018006760 con 0x7f201c134b50 2020-07-16T20:30:54.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1969119029 0 0) 0x7f1ff4003240 con 0x7f201c134460 2020-07-16T20:30:54.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f201c133af0 con 0x7f201c134460 2020-07-16T20:30:54.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f2018006940 con 0x7f201c134460 2020-07-16T20:30:54.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 msgr2=0x7f201c12aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f201c12aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 >> v1:172.21.15.157:6789/0 conn(0x7f201c134460 legacy=0x7f201c128900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 >> v1:172.21.15.41:6789/0 conn(0x7f201c134b50 legacy=0x7f201c0aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff4003970 0x7f1ff4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f1ff40044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff40049d0 0x7f1ff4004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c129450 con 0x7f1ff4003970 2020-07-16T20:30:54.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40053a0 con 0x7f1ff40049d0 2020-07-16T20:30:54.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff400b7b0 con 0x7f201c129010 2020-07-16T20:30:54.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff40049d0 0x7f1ff4004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2021a42700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff4003970 0x7f1ff4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2021241700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f1ff40044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 -- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 msgr2=0x7f1ff40044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f1ff40044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 -- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff4003970 msgr2=0x7f1ff4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff4003970 0x7f1ff4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c133d20 con 0x7f1ff40049d0 2020-07-16T20:30:54.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2021241700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f201c129010 0x7f1ff40044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:54.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c133fc0 con 0x7f1ff40049d0 2020-07-16T20:30:54.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2022243700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff40049d0 0x7f1ff4004e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f201400b000 tx=0x7f20140091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.606+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c067a60 con 0x7f1ff40049d0 2020-07-16T20:30:54.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.607+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c0ab460 con 0x7f1ff40049d0 2020-07-16T20:30:54.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2014006a80 con 0x7f1ff40049d0 2020-07-16T20:30:54.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014012ad0 con 0x7f1ff40049d0 2020-07-16T20:30:54.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2014012e30 con 0x7f1ff40049d0 2020-07-16T20:30:54.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2014025070 con 0x7f1ff40049d0 2020-07-16T20:30:54.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1ff4058460 0x7f1ff405a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2014068cb0 con 0x7f1ff40049d0 2020-07-16T20:30:54.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.608+0000 7f2021a42700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1ff4058460 0x7f1ff405a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.646 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.609+0000 7f2021a42700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1ff4058460 0x7f1ff405a920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f200c014000 tx=0x7f200c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.646 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.611+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f20140413e0 con 0x7f1ff40049d0 2020-07-16T20:30:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.761+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f201c0ab460 con 0x7f1ff40049d0 2020-07-16T20:30:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.761+0000 7f2009ffb700 1 -- 172.21.15.157:0/2679092999 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f201c0ab460 con 0x7f1ff40049d0 2020-07-16T20:30:54.764 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:30:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.762+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1ff4058460 msgr2=0x7f1ff405a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.762+0000 7f2023ca6700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1ff4058460 0x7f1ff405a920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f200c014000 tx=0x7f200c015000).stop 2020-07-16T20:30:54.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff40049d0 msgr2=0x7f1ff4004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 --2- 172.21.15.157:0/2679092999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff40049d0 0x7f1ff4004e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f201400b000 tx=0x7f20140091d0).stop 2020-07-16T20:30:54.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2022243700 1 -- 172.21.15.157:0/2679092999 reap_dead start 2020-07-16T20:30:54.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2022243700 1 -- 172.21.15.157:0/2679092999 reap_dead start 2020-07-16T20:30:54.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 shutdown_connections 2020-07-16T20:30:54.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 >> 172.21.15.157:0/2679092999 conn(0x7f201c09e7e0 msgr2=0x7f201c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 shutdown_connections 2020-07-16T20:30:54.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.763+0000 7f2023ca6700 1 -- 172.21.15.157:0/2679092999 wait complete. 2020-07-16T20:30:54.774 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-07-16T20:30:54.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-07-16T20:30:54.776 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-07-16T20:30:54.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 Processor -- start 2020-07-16T20:30:54.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 -- start start 2020-07-16T20:30:54.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc30c09fb60 0x7fc30c0a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0a05c0 con 0x7fc30c067ff0 2020-07-16T20:30:54.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0a5250 con 0x7fc30c0a1180 2020-07-16T20:30:54.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc310814700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0a1ce0 con 0x7fc30c09fb60 2020-07-16T20:30:54.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc30a59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc30c09fb60 0x7fc30c0a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc30b59e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc30c0a1180 0x7fc30c141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36512/0 (socket says 172.21.15.157:36512) 2020-07-16T20:30:54.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.888+0000 7fc30b59e700 1 -- 172.21.15.157:0/1777702712 learned_addr learned my addr 172.21.15.157:0/1777702712 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:54.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc30a59c700 1 -- 172.21.15.157:0/1777702712 >> v1:172.21.15.157:6789/0 conn(0x7fc30c0a1180 legacy=0x7fc30c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc30a59c700 1 -- 172.21.15.157:0/1777702712 >> v1:172.21.15.41:6789/0 conn(0x7fc30c067ff0 legacy=0x7fc30c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:54.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc309d9b700 1 -- 172.21.15.157:0/1777702712 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266314126 0 0) 0x7fc30c0a5250 con 0x7fc30c0a1180 2020-07-16T20:30:54.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc30a59c700 1 -- 172.21.15.157:0/1777702712 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c09fff0 con 0x7fc30c09fb60 2020-07-16T20:30:54.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc30a59c700 1 --2- 172.21.15.157:0/1777702712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc30c09fb60 0x7fc30c0a0c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc30c0a22c0 tx=0x7fc2f4006dd0).ready entity=mon.1 client_cookie=f00659fc21e5bf2f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc309d9b700 1 -- 172.21.15.157:0/1777702712 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f40097b0 con 0x7fc30c09fb60 2020-07-16T20:30:54.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc309d9b700 1 -- 172.21.15.157:0/1777702712 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4009910 con 0x7fc30c09fb60 2020-07-16T20:30:54.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc309d9b700 1 -- 172.21.15.157:0/1777702712 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f4009c70 con 0x7fc30c09fb60 2020-07-16T20:30:54.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 -- 172.21.15.157:0/1777702712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc30c09fb60 msgr2=0x7fc30c0a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 --2- 172.21.15.157:0/1777702712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc30c09fb60 0x7fc30c0a0c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc30c0a22c0 tx=0x7fc2f4006dd0).stop 2020-07-16T20:30:54.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 -- 172.21.15.157:0/1777702712 shutdown_connections 2020-07-16T20:30:54.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 --2- 172.21.15.157:0/1777702712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc30c09fb60 0x7fc30c0a0c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 -- 172.21.15.157:0/1777702712 >> 172.21.15.157:0/1777702712 conn(0x7fc30c05b810 msgr2=0x7fc30c05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:54.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 -- 172.21.15.157:0/1777702712 shutdown_connections 2020-07-16T20:30:54.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.889+0000 7fc310814700 1 -- 172.21.15.157:0/1777702712 wait complete. 2020-07-16T20:30:54.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.890+0000 7fc310814700 1 Processor -- start 2020-07-16T20:30:54.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc310814700 1 -- start start 2020-07-16T20:30:54.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc310814700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc30c14b110 0x7fc30c12dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc310814700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c130c70 con 0x7fc30c0a1180 2020-07-16T20:30:54.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc310814700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c132310 con 0x7fc30c067ff0 2020-07-16T20:30:54.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc310814700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c1325b0 con 0x7fc30c14b110 2020-07-16T20:30:54.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc30ad9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc30c067ff0 0x7fc30c1310a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36514/0 (socket says 172.21.15.157:36514) 2020-07-16T20:30:54.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc30ad9d700 1 -- 172.21.15.157:0/2434526038 learned_addr learned my addr 172.21.15.157:0/2434526038 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:54.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc30b59e700 1 --2- 172.21.15.157:0/2434526038 >> v2:172.21.15.41:3300/0 conn(0x7fc30c14b110 0x7fc30c12dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334966802 0 0) 0x7fc30c132310 con 0x7fc30c067ff0 2020-07-16T20:30:54.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.891+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e8003240 con 0x7fc30c067ff0 2020-07-16T20:30:54.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 382741257 0 0) 0x7fc2e8003240 con 0x7fc30c067ff0 2020-07-16T20:30:54.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc30c132310 con 0x7fc30c067ff0 2020-07-16T20:30:54.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fc2fc002910 con 0x7fc30c067ff0 2020-07-16T20:30:54.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 >> v2:172.21.15.41:3300/0 conn(0x7fc30c14b110 msgr2=0x7fc30c12dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 --2- 172.21.15.157:0/2434526038 >> v2:172.21.15.41:3300/0 conn(0x7fc30c14b110 0x7fc30c12dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 >> v1:172.21.15.157:6789/0 conn(0x7fc30c067ff0 legacy=0x7fc30c1310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 >> v1:172.21.15.41:6789/0 conn(0x7fc30c0a1180 legacy=0x7fc30c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 0x7fc2e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc2e80044e0 0x7fc2e8004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2e8004e10 0x7fc2e800b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1325b0 con 0x7fc2e8004e10 2020-07-16T20:30:54.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e800bc20 con 0x7fc2e8003800 2020-07-16T20:30:54.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e800bd90 con 0x7fc2e80044e0 2020-07-16T20:30:54.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30b59e700 1 --2- 172.21.15.157:0/2434526038 >> v2:172.21.15.41:3300/0 conn(0x7fc30c14b110 0x7fc30c12dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:54.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 0x7fc2e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30a59c700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc2e80044e0 0x7fc2e8004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30b59e700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2e8004e10 0x7fc2e800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 -- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc2e80044e0 msgr2=0x7fc2e8004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fc2e80044e0 0x7fc2e8004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 -- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2e8004e10 msgr2=0x7fc2e800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:54.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2e8004e10 0x7fc2e800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:54.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c12e4f0 con 0x7fc2e8003800 2020-07-16T20:30:54.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30b59e700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2e8004e10 0x7fc2e800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:54.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30b59e700 1 -- 172.21.15.157:0/2434526038 reap_dead start 2020-07-16T20:30:54.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c1317b0 con 0x7fc2e8003800 2020-07-16T20:30:54.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c131fc0 con 0x7fc2e8003800 2020-07-16T20:30:54.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc30ad9d700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 0x7fc2e8003c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc2fc002620 tx=0x7fc2fc007810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc00ae50 con 0x7fc2e8003800 2020-07-16T20:30:54.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc007110 con 0x7fc2e8003800 2020-07-16T20:30:54.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.892+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc0054e0 con 0x7fc2e8003800 2020-07-16T20:30:54.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.893+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c057490 con 0x7fc2e8003800 2020-07-16T20:30:54.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.893+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fc2fc010030 con 0x7fc2e8003800 2020-07-16T20:30:54.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.893+0000 7fc302ffd700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 0x7fc2e8056450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:54.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.893+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc2fc068260 con 0x7fc2e8003800 2020-07-16T20:30:54.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.894+0000 7fc30a59c700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 0x7fc2e8056450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:54.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.894+0000 7fc30a59c700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 0x7fc2e8056450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc2f401a000 tx=0x7fc2f4015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:54.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:54.897+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fc2fc040990 con 0x7fc2e8003800 2020-07-16T20:30:55.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.081+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc30c043fd0 con 0x7fc2e8003800 2020-07-16T20:30:55.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.084+0000 7fc302ffd700 1 -- 172.21.15.157:0/2434526038 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+124404 (secure 0 0 0) 0x7fc2fc043fb0 con 0x7fc2e8003800 2020-07-16T20:30:55.088 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:55.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.085+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 msgr2=0x7fc2e8056450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.085+0000 7fc310814700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 0x7fc2e8056450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc2f401a000 tx=0x7fc2f4015000).stop 2020-07-16T20:30:55.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.085+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 msgr2=0x7fc2e8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.085+0000 7fc310814700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 0x7fc2e8003c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc2fc002620 tx=0x7fc2fc007810).stop 2020-07-16T20:30:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 shutdown_connections 2020-07-16T20:30:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fc2e8053f90 0x7fc2e8056450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 --2- 172.21.15.157:0/2434526038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2e8003800 0x7fc2e8003c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:55.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 >> 172.21.15.157:0/2434526038 conn(0x7fc30c05b810 msgr2=0x7fc30c0a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:55.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 shutdown_connections 2020-07-16T20:30:55.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.086+0000 7fc310814700 1 -- 172.21.15.157:0/2434526038 wait complete. 2020-07-16T20:30:55.097 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":4,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":23153},{"type":"v1","addr":"172.21.15.157:6801","nonce":23153}]},"active_addr":"172.21.15.157:6801/23153","active_change":"2020-07-16T20:30:32.540851+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138292837744639,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":1342215389}]},{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":903469690}]},{"addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3937295331}]}]}} 2020-07-16T20:30:55.103 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-07-16T20:30:55.103 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-07-16T20:30:55.105 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:55.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.210+0000 7ff1a8eab700 1 Processor -- start 2020-07-16T20:30:55.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.210+0000 7ff1a8eab700 1 -- start start 2020-07-16T20:30:55.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a8eab700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 0x7ff1a4133390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:55.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a8eab700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40a5450 con 0x7ff1a40a86c0 2020-07-16T20:30:55.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a8eab700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40a7880 con 0x7ff1a40a48e0 2020-07-16T20:30:55.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a8eab700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40a56b0 con 0x7ff1a40a4cc0 2020-07-16T20:30:55.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff1a40a48e0 0x7ff1a40a7fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36528/0 (socket says 172.21.15.157:36528) 2020-07-16T20:30:55.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a259c700 1 -- 172.21.15.157:0/3911975910 learned_addr learned my addr 172.21.15.157:0/3911975910 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:55.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a2d9d700 1 --2- 172.21.15.157:0/3911975910 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 0x7ff1a4133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:55.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306132111 0 0) 0x7ff1a40a7880 con 0x7ff1a40a48e0 2020-07-16T20:30:55.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff188003240 con 0x7ff1a40a48e0 2020-07-16T20:30:55.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670677625 0 0) 0x7ff1a40a5450 con 0x7ff1a40a86c0 2020-07-16T20:30:55.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a40a7880 con 0x7ff1a40a86c0 2020-07-16T20:30:55.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.211+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1911880764 0 0) 0x7ff188003240 con 0x7ff1a40a48e0 2020-07-16T20:30:55.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3911975910 >> v1:172.21.15.157:6789/0 conn(0x7ff1a40a48e0 legacy=0x7ff1a40a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3911975910 >> v1:172.21.15.41:6789/0 conn(0x7ff1a40a86c0 legacy=0x7ff1a4132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3911975910 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40a5950 con 0x7ff1a40a4cc0 2020-07-16T20:30:55.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a2d9d700 1 --2- 172.21.15.157:0/3911975910 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 0x7ff1a4133390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff198001870 tx=0x7ff19c0091d0).ready entity=mon.2 client_cookie=2e3b86b153227688 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:55.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1980016d0 con 0x7ff1a40a4cc0 2020-07-16T20:30:55.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00b880 con 0x7ff1a40a4cc0 2020-07-16T20:30:55.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a159a700 1 -- 172.21.15.157:0/3911975910 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff19c00b9f0 con 0x7ff1a40a4cc0 2020-07-16T20:30:55.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3911975910 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 msgr2=0x7ff1a4133390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3911975910 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 0x7ff1a4133390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff198001870 tx=0x7ff19c0091d0).stop 2020-07-16T20:30:55.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3911975910 shutdown_connections 2020-07-16T20:30:55.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3911975910 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff1a40a4cc0 0x7ff1a4133390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:55.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3911975910 >> 172.21.15.157:0/3911975910 conn(0x7ff1a4061820 msgr2=0x7ff1a409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:55.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3911975910 shutdown_connections 2020-07-16T20:30:55.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.212+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3911975910 wait complete. 2020-07-16T20:30:55.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.213+0000 7ff1a8eab700 1 Processor -- start 2020-07-16T20:30:55.231 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.213+0000 7ff1a8eab700 1 -- start start 2020-07-16T20:30:55.231 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a8eab700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1a40a86c0 0x7ff1a4128130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:55.231 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a8eab700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1a4140b00 0x7ff1a4125a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:55.232 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a8eab700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40abac0 con 0x7ff1a40a48e0 2020-07-16T20:30:55.233 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a8eab700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40a9e10 con 0x7ff1a40a86c0 2020-07-16T20:30:55.234 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a8eab700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40ab860 con 0x7ff1a4140b00 2020-07-16T20:30:55.234 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1a4140b00 0x7ff1a4125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:55.234 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff1a40a48e0 0x7ff1a40a9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36538/0 (socket says 172.21.15.157:36538) 2020-07-16T20:30:55.235 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1a4140b00 0x7ff1a4125a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33848/0 (socket says 172.21.15.157:33848) 2020-07-16T20:30:55.235 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a259c700 1 -- 172.21.15.157:0/3399680863 learned_addr learned my addr 172.21.15.157:0/3399680863 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:55.235 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a1d9b700 1 --2- 172.21.15.157:0/3399680863 >> v2:172.21.15.41:3300/0 conn(0x7ff1a40a86c0 0x7ff1a4128130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:55.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3399680863 >> v2:172.21.15.41:3300/0 conn(0x7ff1a40a86c0 msgr2=0x7ff1a4128130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 --2- 172.21.15.157:0/3399680863 >> v2:172.21.15.41:3300/0 conn(0x7ff1a40a86c0 0x7ff1a4128130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:55.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3399680863 >> v1:172.21.15.157:6789/0 conn(0x7ff1a40a48e0 legacy=0x7ff1a40a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:55.237 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220990425 0 0) 0x7ff1a40abac0 con 0x7ff1a40a48e0 2020-07-16T20:30:55.237 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 -- 172.21.15.157:0/3399680863 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4141b20 con 0x7ff1a4140b00 2020-07-16T20:30:55.238 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.214+0000 7ff1a2d9d700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1a4140b00 0x7ff1a4125a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff1a4141890 tx=0x7ff19c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:55.238 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.215+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff19c0105b0 con 0x7ff1a4140b00 2020-07-16T20:30:55.238 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.215+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a413ffb0 con 0x7ff1a4140b00 2020-07-16T20:30:55.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.215+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c010710 con 0x7ff1a4140b00 2020-07-16T20:30:55.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.215+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff19c010a70 con 0x7ff1a4140b00 2020-07-16T20:30:55.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.215+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a4141010 con 0x7ff1a4140b00 2020-07-16T20:30:55.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a4057490 con 0x7ff1a4140b00 2020-07-16T20:30:55.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff19c01e070 con 0x7ff1a4140b00 2020-07-16T20:30:55.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1927fc700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 0x7ff178052220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:55.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff19c068b20 con 0x7ff1a4140b00 2020-07-16T20:30:55.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1a259c700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 0x7ff178052220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:55.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.216+0000 7ff1a259c700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 0x7ff178052220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff198001820 tx=0x7ff198001360).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:55.242 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.219+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff19c041280 con 0x7ff1a4140b00 2020-07-16T20:30:55.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.366+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a4141cb0 con 0x7ff1a4140b00 2020-07-16T20:30:56.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.367+0000 7ff1927fc700 1 -- 172.21.15.157:0/3399680863 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7ff19c01b090 con 0x7ff1a4140b00 2020-07-16T20:30:56.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 msgr2=0x7ff178052220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 0x7ff178052220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff198001820 tx=0x7ff198001360).stop 2020-07-16T20:30:56.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1a4140b00 msgr2=0x7ff1a4125a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1a4140b00 0x7ff1a4125a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff1a4141890 tx=0x7ff19c016000).stop 2020-07-16T20:30:56.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 shutdown_connections 2020-07-16T20:30:56.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff17804fd60 0x7ff178052220 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3399680863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1a4140b00 0x7ff1a4125a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 --2- 172.21.15.157:0/3399680863 >> v2:172.21.15.41:3300/0 conn(0x7ff1a40a86c0 0x7ff1a4128130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 >> 172.21.15.157:0/3399680863 conn(0x7ff1a4061820 msgr2=0x7ff1a405f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:56.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 shutdown_connections 2020-07-16T20:30:56.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:55.368+0000 7ff1a8eab700 1 -- 172.21.15.157:0/3399680863 wait complete. 2020-07-16T20:30:56.640 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:56.640 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:56.641 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-07-16T20:30:56.642 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:56.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.757+0000 7f582e3ca700 1 Processor -- start 2020-07-16T20:30:56.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.757+0000 7f582e3ca700 1 -- start start 2020-07-16T20:30:56.761 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58280a86c0 0x7f58280a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:56.761 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280a5450 con 0x7f5828132c80 2020-07-16T20:30:56.761 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280a7880 con 0x7f58280a48e0 2020-07-16T20:30:56.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280a56b0 con 0x7f58280a86c0 2020-07-16T20:30:56.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f58277fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58280a86c0 0x7f58280a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:56.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5827fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f58280a48e0 0x7f58280a7fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36542/0 (socket says 172.21.15.157:36542) 2020-07-16T20:30:56.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5827fff700 1 -- 172.21.15.157:0/2459781057 learned_addr learned my addr 172.21.15.157:0/2459781057 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:56.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f58277fe700 1 -- 172.21.15.157:0/2459781057 >> v1:172.21.15.157:6789/0 conn(0x7f58280a48e0 legacy=0x7f58280a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f58277fe700 1 -- 172.21.15.157:0/2459781057 >> v1:172.21.15.41:6789/0 conn(0x7f5828132c80 legacy=0x7f5828133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5826ffd700 1 -- 172.21.15.157:0/2459781057 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123067454 0 0) 0x7f58280a7880 con 0x7f58280a48e0 2020-07-16T20:30:56.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f58277fe700 1 -- 172.21.15.157:0/2459781057 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280a5950 con 0x7f58280a86c0 2020-07-16T20:30:56.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f58277fe700 1 --2- 172.21.15.157:0/2459781057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58280a86c0 0x7f58280a4cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f581c002f30 tx=0x7f581c006dd0).ready entity=mon.1 client_cookie=dd6f9d3c1fbcdc9e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:56.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5826ffd700 1 -- 172.21.15.157:0/2459781057 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581c0097f0 con 0x7f58280a86c0 2020-07-16T20:30:56.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5826ffd700 1 -- 172.21.15.157:0/2459781057 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c009950 con 0x7f58280a86c0 2020-07-16T20:30:56.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f5826ffd700 1 -- 172.21.15.157:0/2459781057 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581c009cb0 con 0x7f58280a86c0 2020-07-16T20:30:56.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 -- 172.21.15.157:0/2459781057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58280a86c0 msgr2=0x7f58280a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.758+0000 7f582e3ca700 1 --2- 172.21.15.157:0/2459781057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58280a86c0 0x7f58280a4cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f581c002f30 tx=0x7f581c006dd0).stop 2020-07-16T20:30:56.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.759+0000 7f582e3ca700 1 -- 172.21.15.157:0/2459781057 shutdown_connections 2020-07-16T20:30:56.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.759+0000 7f582e3ca700 1 --2- 172.21.15.157:0/2459781057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58280a86c0 0x7f58280a4cc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.759+0000 7f582e3ca700 1 -- 172.21.15.157:0/2459781057 >> 172.21.15.157:0/2459781057 conn(0x7f5828061820 msgr2=0x7f582809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:56.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.759+0000 7f582e3ca700 1 -- 172.21.15.157:0/2459781057 shutdown_connections 2020-07-16T20:30:56.765 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.759+0000 7f582e3ca700 1 -- 172.21.15.157:0/2459781057 wait complete. 2020-07-16T20:30:56.767 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.760+0000 7f582e3ca700 1 Processor -- start 2020-07-16T20:30:56.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.760+0000 7f582e3ca700 1 -- start start 2020-07-16T20:30:56.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f582814af60 0x7f58281318b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:56.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582809f7e0 con 0x7f5828132c80 2020-07-16T20:30:56.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280a05c0 con 0x7f58280a48e0 2020-07-16T20:30:56.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280a2100 con 0x7f582814af60 2020-07-16T20:30:56.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f5827fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f58280a48e0 0x7f582809feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36548/0 (socket says 172.21.15.157:36548) 2020-07-16T20:30:56.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f5827fff700 1 -- 172.21.15.157:0/30149037 learned_addr learned my addr 172.21.15.157:0/30149037 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:56.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582c967700 1 --2- 172.21.15.157:0/30149037 >> v2:172.21.15.157:3300/0 conn(0x7f582814af60 0x7f58281318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:56.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582c967700 1 -- 172.21.15.157:0/30149037 >> v1:172.21.15.157:6789/0 conn(0x7f58280a48e0 legacy=0x7f582809feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582c967700 1 -- 172.21.15.157:0/30149037 >> v1:172.21.15.41:6789/0 conn(0x7f5828132c80 legacy=0x7f582814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582c967700 1 -- 172.21.15.157:0/30149037 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582809fa10 con 0x7f582814af60 2020-07-16T20:30:56.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582c967700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582814af60 0x7f58281318b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f58280a4240 tx=0x7f5820007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:56.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582000a6f0 con 0x7f582814af60 2020-07-16T20:30:56.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000a850 con 0x7f582814af60 2020-07-16T20:30:56.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582000aa00 con 0x7f582814af60 2020-07-16T20:30:56.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58280a24c0 con 0x7f582814af60 2020-07-16T20:30:56.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.761+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5828132430 con 0x7f582814af60 2020-07-16T20:30:56.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.762+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828057490 con 0x7f582814af60 2020-07-16T20:30:56.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.762+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5820010070 con 0x7f582814af60 2020-07-16T20:30:56.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.763+0000 7f5807fff700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 0x7f58000523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:56.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.763+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f58200678a0 con 0x7f582814af60 2020-07-16T20:30:56.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.763+0000 7f5827fff700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 0x7f58000523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:56.773 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.763+0000 7f5827fff700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 0x7f58000523c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f58281322e0 tx=0x7f5818007720).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:56.774 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.766+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5820040030 con 0x7f582814af60 2020-07-16T20:30:56.918 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.916+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58280a2c30 con 0x7f582814af60 2020-07-16T20:30:56.918 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.917+0000 7f5807fff700 1 -- 172.21.15.157:0/30149037 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f5820043650 con 0x7f582814af60 2020-07-16T20:30:56.919 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:30:56.919 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:56.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 msgr2=0x7f58000523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 0x7f58000523c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f58281322e0 tx=0x7f5818007720).stop 2020-07-16T20:30:56.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582814af60 msgr2=0x7f58281318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:56.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582814af60 0x7f58281318b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f58280a4240 tx=0x7f5820007dc0).stop 2020-07-16T20:30:56.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 shutdown_connections 2020-07-16T20:30:56.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f580004ff00 0x7f58000523c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 --2- 172.21.15.157:0/30149037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582814af60 0x7f58281318b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:56.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 >> 172.21.15.157:0/30149037 conn(0x7f5828061820 msgr2=0x7f58280a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:56.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 shutdown_connections 2020-07-16T20:30:56.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:56.919+0000 7f582e3ca700 1 -- 172.21.15.157:0/30149037 wait complete. 2020-07-16T20:30:56.931 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-07-16T20:30:57.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.037+0000 7f8cf566d700 1 Processor -- start 2020-07-16T20:30:57.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.037+0000 7f8cf566d700 1 -- start start 2020-07-16T20:30:57.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 0x7f8cf00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8cf00a8460 0x7f8cf00abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00a5450 con 0x7f8cf00a7fb0 2020-07-16T20:30:57.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00a7880 con 0x7f8cf00a8460 2020-07-16T20:30:57.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00a56b0 con 0x7f8cf00a48e0 2020-07-16T20:30:57.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8cf00a8460 0x7f8cf00abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8cf00a8460 0x7f8cf00abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33872/0 (socket says 172.21.15.157:33872) 2020-07-16T20:30:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cee7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8cf00a7fb0 0x7f8cf00ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36558/0 (socket says 172.21.15.157:36558) 2020-07-16T20:30:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 -- 172.21.15.157:0/3525231846 learned_addr learned my addr 172.21.15.157:0/3525231846 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8ceeffd700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 0x7f8cf00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 -- 172.21.15.157:0/3525231846 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 msgr2=0x7f8cf00a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 0x7f8cf00a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 -- 172.21.15.157:0/3525231846 >> v1:172.21.15.157:6789/0 conn(0x7f8cf00a7fb0 legacy=0x7f8cf00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 -- 172.21.15.157:0/3525231846 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00a5950 con 0x7f8cf00a8460 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cedffb700 1 -- 172.21.15.157:0/3525231846 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389957499 0 0) 0x7f8cf00a5450 con 0x7f8cf00a7fb0 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8ceeffd700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 0x7f8cf00a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cf00a8460 0x7f8cf00abe90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8ce80032b0 tx=0x7f8ce8009270).ready entity=mon.1 client_cookie=bc24a9cd25800c15 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cedffb700 1 -- 172.21.15.157:0/3525231846 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce800bdf0 con 0x7f8cf00a8460 2020-07-16T20:30:57.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cedffb700 1 -- 172.21.15.157:0/3525231846 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8010470 con 0x7f8cf00a8460 2020-07-16T20:30:57.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cedffb700 1 -- 172.21.15.157:0/3525231846 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce80107d0 con 0x7f8cf00a8460 2020-07-16T20:30:57.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- 172.21.15.157:0/3525231846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cf00a8460 msgr2=0x7f8cf00abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cf00a8460 0x7f8cf00abe90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8ce80032b0 tx=0x7f8ce8009270).stop 2020-07-16T20:30:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- 172.21.15.157:0/3525231846 shutdown_connections 2020-07-16T20:30:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cf00a8460 0x7f8cf00abe90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 --2- 172.21.15.157:0/3525231846 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8cf00a48e0 0x7f8cf00a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- 172.21.15.157:0/3525231846 >> 172.21.15.157:0/3525231846 conn(0x7f8cf0061820 msgr2=0x7f8cf009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- 172.21.15.157:0/3525231846 shutdown_connections 2020-07-16T20:30:57.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.038+0000 7f8cf566d700 1 -- 172.21.15.157:0/3525231846 wait complete. 2020-07-16T20:30:57.052 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 Processor -- start 2020-07-16T20:30:57.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 -- start start 2020-07-16T20:30:57.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8cf009fcc0 0x7f8cf0135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf012db80 con 0x7f8cf00a7fb0 2020-07-16T20:30:57.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf012de20 con 0x7f8cf00a48e0 2020-07-16T20:30:57.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.040+0000 7f8cf566d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00a0150 con 0x7f8cf009fcc0 2020-07-16T20:30:57.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8ceeffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8cf00a48e0 0x7f8cf012ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36564/0 (socket says 172.21.15.157:36564) 2020-07-16T20:30:57.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8ceeffd700 1 -- 172.21.15.157:0/1689211646 learned_addr learned my addr 172.21.15.157:0/1689211646 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/1689211646 >> v2:172.21.15.41:3300/0 conn(0x7f8cf009fcc0 0x7f8cf0135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640878398 0 0) 0x7f8cf012de20 con 0x7f8cf00a48e0 2020-07-16T20:30:57.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc003240 con 0x7f8cf00a48e0 2020-07-16T20:30:57.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1660587811 0 0) 0x7f8ccc003240 con 0x7f8cf00a48e0 2020-07-16T20:30:57.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8cf012de20 con 0x7f8cf00a48e0 2020-07-16T20:30:57.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f8ce40012a0 con 0x7f8cf00a48e0 2020-07-16T20:30:57.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 >> v2:172.21.15.41:3300/0 conn(0x7f8cf009fcc0 msgr2=0x7f8cf0135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> v2:172.21.15.41:3300/0 conn(0x7f8cf009fcc0 0x7f8cf0135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 >> v1:172.21.15.157:6789/0 conn(0x7f8cf00a48e0 legacy=0x7f8cf012ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 >> v1:172.21.15.41:6789/0 conn(0x7f8cf00a7fb0 legacy=0x7f8cf0144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ccc003800 0x7f8ccc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 0x7f8ccc004960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8ccc004e50 0x7f8ccc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00a0150 con 0x7f8ccc003800 2020-07-16T20:30:57.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc00bc20 con 0x7f8ccc0044e0 2020-07-16T20:30:57.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc00bd60 con 0x7f8ccc004e50 2020-07-16T20:30:57.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 0x7f8ccc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8ceeffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ccc003800 0x7f8ccc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8ccc004e50 0x7f8ccc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 -- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8ccc004e50 msgr2=0x7f8ccc00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8ccc004e50 0x7f8ccc00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 -- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ccc003800 msgr2=0x7f8ccc003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ccc003800 0x7f8ccc003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cef7fe700 1 -- 172.21.15.157:0/1689211646 reap_dead start 2020-07-16T20:30:57.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cee7fc700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf012e0c0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.041+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf009f510 con 0x7f8ccc0044e0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf012d070 con 0x7f8ccc0044e0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cee7fc700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 0x7f8ccc004960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f8cf012cde0 tx=0x7f8ce0007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce00072e0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0013450 con 0x7f8ccc0044e0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce00137b0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.042+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cf0133ad0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.061 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8ce001a060 con 0x7f8ccc0044e0 2020-07-16T20:30:57.061 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 0x7f8ccc056310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.061 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8ce00672f0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.061 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8ceeffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 0x7f8ccc056310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.061 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 0x7f8ccc05dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ccc05e390 con 0x7f8ccc05b920 2020-07-16T20:30:57.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ce00697f0 con 0x7f8ccc0044e0 2020-07-16T20:30:57.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 0x7f8ccc05dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.043+0000 7f8ceeffd700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 0x7f8ccc056310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8ce400f000 tx=0x7f8ce4008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.062 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.044+0000 7f8cef7fe700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 0x7f8ccc05dd40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.063 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.044+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== osd.0 v2:172.21.15.157:6802/23737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f8ccc05e390 con 0x7f8ccc05b920 2020-07-16T20:30:57.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.062+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 --> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8cf012e250 con 0x7f8ccc05b920 2020-07-16T20:30:57.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.062+0000 7f8cd6ffd700 1 -- 172.21.15.157:0/1689211646 <== osd.0 v2:172.21.15.157:6802/23737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8cf012e250 con 0x7f8ccc05b920 2020-07-16T20:30:57.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.062+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 msgr2=0x7f8ccc05dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 0x7f8ccc05dd40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 msgr2=0x7f8ccc056310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 0x7f8ccc056310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8ce400f000 tx=0x7f8ce4008040).stop 2020-07-16T20:30:57.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 msgr2=0x7f8ccc004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 0x7f8ccc004960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f8cf012cde0 tx=0x7f8ce0007a50).stop 2020-07-16T20:30:57.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 shutdown_connections 2020-07-16T20:30:57.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f8ccc05b920 0x7f8ccc05dd40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8ccc053e50 0x7f8ccc056310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 --2- 172.21.15.157:0/1689211646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ccc0044e0 0x7f8ccc004960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 >> 172.21.15.157:0/1689211646 conn(0x7f8cf0061820 msgr2=0x7f8cf0132bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 shutdown_connections 2020-07-16T20:30:57.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.063+0000 7f8cf566d700 1 -- 172.21.15.157:0/1689211646 wait complete. 2020-07-16T20:30:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:30:57.074 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-07-16T20:30:57.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.179+0000 7f753b1fc700 1 Processor -- start 2020-07-16T20:30:57.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.179+0000 7f753b1fc700 1 -- start start 2020-07-16T20:30:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f753b1fc700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f75340a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f753b1fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f75340a8460 0x7f75340abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f753b1fc700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340a5450 con 0x7f75340a7fb0 2020-07-16T20:30:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f753b1fc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340a7880 con 0x7f75340a8460 2020-07-16T20:30:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f753b1fc700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340a56b0 con 0x7f75340a48e0 2020-07-16T20:30:57.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f7533fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f75340a7fb0 0x7f75340ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36578/0 (socket says 172.21.15.157:36578) 2020-07-16T20:30:57.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f7533fff700 1 -- 172.21.15.157:0/1374991617 learned_addr learned my addr 172.21.15.157:0/1374991617 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f7538f98700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f75340a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f7539799700 1 --2- 172.21.15.157:0/1374991617 >> v2:172.21.15.41:3300/0 conn(0x7f75340a8460 0x7f75340abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587575992 0 0) 0x7f75340a5450 con 0x7f75340a7fb0 2020-07-16T20:30:57.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.180+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7520003240 con 0x7f75340a7fb0 2020-07-16T20:30:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1439370423 0 0) 0x7f7520003240 con 0x7f75340a7fb0 2020-07-16T20:30:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 msgr2=0x7f75340a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f75340a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 >> v2:172.21.15.41:3300/0 conn(0x7f75340a8460 msgr2=0x7f75340abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 --2- 172.21.15.157:0/1374991617 >> v2:172.21.15.41:3300/0 conn(0x7f75340a8460 0x7f75340abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340a5950 con 0x7f75340a7fb0 2020-07-16T20:30:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f75280016d0 con 0x7f75340a7fb0 2020-07-16T20:30:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 >> v1:172.21.15.157:6789/0 conn(0x7f75340a7fb0 legacy=0x7f75340ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7520003730 0x7f7520003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75200044e0 0x7f7520004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f7520004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340a7880 con 0x7f7520003730 2020-07-16T20:30:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340a56b0 con 0x7f75200044e0 2020-07-16T20:30:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7520004270 con 0x7f75340a48e0 2020-07-16T20:30:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75200044e0 0x7f7520004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7538f98700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7520003730 0x7f7520003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7539799700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f7520004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 -- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 msgr2=0x7f7520004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f7520004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 -- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7520003730 msgr2=0x7f7520003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7520003730 0x7f7520003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 -- 172.21.15.157:0/1374991617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520003240 con 0x7f75200044e0 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7539799700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f75340a48e0 0x7f7520004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7533fff700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75200044e0 0x7f7520004960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f75280013e0 tx=0x7f75340a4210).ready entity=mon.1 client_cookie=ca7d5a512d76ee9b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752800ce00 con 0x7f75200044e0 2020-07-16T20:30:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75280072e0 con 0x7f75200044e0 2020-07-16T20:30:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f75337fe700 1 -- 172.21.15.157:0/1374991617 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75280057e0 con 0x7f75200044e0 2020-07-16T20:30:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f753b1fc700 1 -- 172.21.15.157:0/1374991617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75200044e0 msgr2=0x7f7520004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f753b1fc700 1 --2- 172.21.15.157:0/1374991617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75200044e0 0x7f7520004960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f75280013e0 tx=0x7f75340a4210).stop 2020-07-16T20:30:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f7539799700 1 -- 172.21.15.157:0/1374991617 reap_dead start 2020-07-16T20:30:57.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f753b1fc700 1 -- 172.21.15.157:0/1374991617 shutdown_connections 2020-07-16T20:30:57.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.181+0000 7f753b1fc700 1 -- 172.21.15.157:0/1374991617 >> 172.21.15.157:0/1374991617 conn(0x7f7534061820 msgr2=0x7f753409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.182+0000 7f753b1fc700 1 -- 172.21.15.157:0/1374991617 shutdown_connections 2020-07-16T20:30:57.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.182+0000 7f753b1fc700 1 -- 172.21.15.157:0/1374991617 wait complete. 2020-07-16T20:30:57.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.183+0000 7f753b1fc700 1 Processor -- start 2020-07-16T20:30:57.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.183+0000 7f753b1fc700 1 -- start start 2020-07-16T20:30:57.198 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f75340a1a50 0x7f75341384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.198 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753413a270 con 0x7f75340a1e30 2020-07-16T20:30:57.198 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753413a510 con 0x7f753412d5e0 2020-07-16T20:30:57.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75341389c0 con 0x7f75340a1a50 2020-07-16T20:30:57.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f75340a1a50 0x7f75341384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f75340a1a50 0x7f75341384d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33902/0 (socket says 172.21.15.157:33902) 2020-07-16T20:30:57.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7539799700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f753412d5e0 0x7f753412da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36594/0 (socket says 172.21.15.157:36594) 2020-07-16T20:30:57.199 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 -- 172.21.15.157:0/1126593103 learned_addr learned my addr 172.21.15.157:0/1126593103 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.200 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 -- 172.21.15.157:0/1126593103 >> v1:172.21.15.157:6789/0 conn(0x7f753412d5e0 legacy=0x7f753412da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.200 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 -- 172.21.15.157:0/1126593103 >> v1:172.21.15.41:6789/0 conn(0x7f75340a1e30 legacy=0x7f7534137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284121917 0 0) 0x7f753413a510 con 0x7f753412d5e0 2020-07-16T20:30:57.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 -- 172.21.15.157:0/1126593103 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534138b00 con 0x7f75340a1a50 2020-07-16T20:30:57.201 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7538f98700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75340a1a50 0x7f75341384d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7534139890 tx=0x7f7524008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.202 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752400fa90 con 0x7f75340a1a50 2020-07-16T20:30:57.202 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400fbf0 con 0x7f75340a1a50 2020-07-16T20:30:57.202 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534137aa0 con 0x7f75340a1a50 2020-07-16T20:30:57.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7524014440 con 0x7f75340a1a50 2020-07-16T20:30:57.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.184+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753412e1a0 con 0x7f75340a1a50 2020-07-16T20:30:57.203 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.185+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f753412e450 con 0x7f75340a1a50 2020-07-16T20:30:57.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.185+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f75240145f0 con 0x7f75340a1a50 2020-07-16T20:30:57.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.185+0000 7f7530ff9700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f750c04fd50 0x7f750c052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.204 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f75240686e0 con 0x7f75340a1a50 2020-07-16T20:30:57.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7533fff700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f750c04fd50 0x7f750c052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7530ff9700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7f750c057840 0x7f750c059c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.205 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 --> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f750c05a2b0 con 0x7f750c057840 2020-07-16T20:30:57.206 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f752406ad50 con 0x7f75340a1a50 2020-07-16T20:30:57.206 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7539799700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7f750c057840 0x7f750c059c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.206 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7533fff700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f750c04fd50 0x7f750c052210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f75340a2540 tx=0x7f7528015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.206 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.186+0000 7f7539799700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7f750c057840 0x7f750c059c60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.207 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.187+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== osd.1 v2:172.21.15.157:6818/23739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f750c05a2b0 con 0x7f750c057840 2020-07-16T20:30:57.211 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.204+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 --> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f753413a6a0 con 0x7f750c057840 2020-07-16T20:30:57.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f7530ff9700 1 -- 172.21.15.157:0/1126593103 <== osd.1 v2:172.21.15.157:6818/23739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f753413a6a0 con 0x7f750c057840 2020-07-16T20:30:57.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7f750c057840 msgr2=0x7f750c059c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7f750c057840 0x7f750c059c60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f750c04fd50 msgr2=0x7f750c052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f750c04fd50 0x7f750c052210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f75340a2540 tx=0x7f7528015000).stop 2020-07-16T20:30:57.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75340a1a50 msgr2=0x7f75341384d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75340a1a50 0x7f75341384d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7534139890 tx=0x7f7524008040).stop 2020-07-16T20:30:57.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f7539799700 1 -- 172.21.15.157:0/1126593103 reap_dead start 2020-07-16T20:30:57.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 shutdown_connections 2020-07-16T20:30:57.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 --2- 172.21.15.157:0/1126593103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75340a1a50 0x7f75341384d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 >> 172.21.15.157:0/1126593103 conn(0x7f7534061820 msgr2=0x7f753405bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 shutdown_connections 2020-07-16T20:30:57.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.205+0000 7f753b1fc700 1 -- 172.21.15.157:0/1126593103 wait complete. 2020-07-16T20:30:57.217 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:57.217 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-07-16T20:30:57.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.323+0000 7f50c9a45700 1 Processor -- start 2020-07-16T20:30:57.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.323+0000 7f50c9a45700 1 -- start start 2020-07-16T20:30:57.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c9a45700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 0x7f50c40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c9a45700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f50c40a7fb0 0x7f50c40a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c9a45700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40a5450 con 0x7f50c40ab780 2020-07-16T20:30:57.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c9a45700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40a7880 con 0x7f50c40a48e0 2020-07-16T20:30:57.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c9a45700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40a56b0 con 0x7f50c40a7fb0 2020-07-16T20:30:57.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f50c40a7fb0 0x7f50c40a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f50c40a7fb0 0x7f50c40a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33916/0 (socket says 172.21.15.157:33916) 2020-07-16T20:30:57.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 -- 172.21.15.157:0/4230185500 learned_addr learned my addr 172.21.15.157:0/4230185500 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c2ffd700 1 --2- 172.21.15.157:0/4230185500 >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 0x7f50c40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 -- 172.21.15.157:0/4230185500 >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 msgr2=0x7f50c40a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 --2- 172.21.15.157:0/4230185500 >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 0x7f50c40a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 -- 172.21.15.157:0/4230185500 >> v1:172.21.15.41:6789/0 conn(0x7f50c40ab780 legacy=0x7f50c40abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c27fc700 1 -- 172.21.15.157:0/4230185500 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40a5950 con 0x7f50c40a7fb0 2020-07-16T20:30:57.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.324+0000 7f50c2ffd700 1 --2- 172.21.15.157:0/4230185500 >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 0x7f50c40a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:57.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c27fc700 1 --2- 172.21.15.157:0/4230185500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40a7fb0 0x7f50c40a8420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f50c41361f0 tx=0x7f50b4006e90).ready entity=mon.1 client_cookie=e12b1e8ba71befed server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c1ffb700 1 -- 172.21.15.157:0/4230185500 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b4009930 con 0x7f50c40a7fb0 2020-07-16T20:30:57.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c1ffb700 1 -- 172.21.15.157:0/4230185500 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4009a90 con 0x7f50c40a7fb0 2020-07-16T20:30:57.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c1ffb700 1 -- 172.21.15.157:0/4230185500 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b4009e30 con 0x7f50c40a7fb0 2020-07-16T20:30:57.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 -- 172.21.15.157:0/4230185500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40a7fb0 msgr2=0x7f50c40a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 --2- 172.21.15.157:0/4230185500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40a7fb0 0x7f50c40a8420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f50c41361f0 tx=0x7f50b4006e90).stop 2020-07-16T20:30:57.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 -- 172.21.15.157:0/4230185500 shutdown_connections 2020-07-16T20:30:57.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 --2- 172.21.15.157:0/4230185500 >> v2:172.21.15.41:3300/0 conn(0x7f50c40a48e0 0x7f50c40a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 --2- 172.21.15.157:0/4230185500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40a7fb0 0x7f50c40a8420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 -- 172.21.15.157:0/4230185500 >> 172.21.15.157:0/4230185500 conn(0x7f50c4061820 msgr2=0x7f50c409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 -- 172.21.15.157:0/4230185500 shutdown_connections 2020-07-16T20:30:57.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.325+0000 7f50c9a45700 1 -- 172.21.15.157:0/4230185500 wait complete. 2020-07-16T20:30:57.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 Processor -- start 2020-07-16T20:30:57.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 -- start start 2020-07-16T20:30:57.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50c40ab780 0x7f50c40a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f50c40aa8f0 0x7f50c414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40aad90 con 0x7f50c40a48e0 2020-07-16T20:30:57.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c4133ec0 con 0x7f50c40ab780 2020-07-16T20:30:57.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c9a45700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40ab030 con 0x7f50c40aa8f0 2020-07-16T20:30:57.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50c40ab780 0x7f50c40a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f50c40aa8f0 0x7f50c414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c2ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f50c40a48e0 0x7f50c4128eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50182/0 (socket says 172.21.15.157:50182) 2020-07-16T20:30:57.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50c40ab780 0x7f50c40a6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:59158/0 (socket says 172.21.15.157:59158) 2020-07-16T20:30:57.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.327+0000 7f50c2ffd700 1 -- 172.21.15.157:0/1251065079 learned_addr learned my addr 172.21.15.157:0/1251065079 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c27fc700 1 -- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f50c40aa8f0 msgr2=0x7f50c414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c27fc700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f50c40aa8f0 0x7f50c414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c27fc700 1 -- 172.21.15.157:0/1251065079 >> v1:172.21.15.41:6789/0 conn(0x7f50c40a48e0 legacy=0x7f50c4128eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334234261 0 0) 0x7f50c40aad90 con 0x7f50c40a48e0 2020-07-16T20:30:57.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c27fc700 1 -- 172.21.15.157:0/1251065079 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c414a450 con 0x7f50c40ab780 2020-07-16T20:30:57.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c27fc700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50c40ab780 0x7f50c40a6350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f50c41361f0 tx=0x7f50b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b4011e40 con 0x7f50c40ab780 2020-07-16T20:30:57.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b401d5d0 con 0x7f50c40ab780 2020-07-16T20:30:57.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c41295c0 con 0x7f50c40ab780 2020-07-16T20:30:57.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b401d930 con 0x7f50c40ab780 2020-07-16T20:30:57.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.328+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c40a6be0 con 0x7f50c40ab780 2020-07-16T20:30:57.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.329+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50c4057490 con 0x7f50c40ab780 2020-07-16T20:30:57.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.329+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f50b4025030 con 0x7f50c40ab780 2020-07-16T20:30:57.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50aaffd700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f50a004fe00 0x7f50a00522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f50b4069630 con 0x7f50c40ab780 2020-07-16T20:30:57.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50c2ffd700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f50a004fe00 0x7f50a00522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50aaffd700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7f50a0057970 0x7f50a0059d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 --> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a005a3e0 con 0x7f50a0057970 2020-07-16T20:30:57.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b4069950 con 0x7f50c40ab780 2020-07-16T20:30:57.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50c37fe700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7f50a0057970 0x7f50a0059d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50c2ffd700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f50a004fe00 0x7f50a00522c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f50b8003070 tx=0x7f50b8008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.330+0000 7f50c37fe700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7f50a0057970 0x7f50a0059d90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.331+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== osd.2 v2:172.21.15.157:6810/23738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f50a005a3e0 con 0x7f50a0057970 2020-07-16T20:30:57.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.348+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 --> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50c414a650 con 0x7f50a0057970 2020-07-16T20:30:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50aaffd700 1 -- 172.21.15.157:0/1251065079 <== osd.2 v2:172.21.15.157:6810/23738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50bc003150 con 0x7f50a0057970 2020-07-16T20:30:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7f50a0057970 msgr2=0x7f50a0059d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7f50a0057970 0x7f50a0059d90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f50a004fe00 msgr2=0x7f50a00522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f50a004fe00 0x7f50a00522c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f50b8003070 tx=0x7f50b8008040).stop 2020-07-16T20:30:57.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50c40ab780 msgr2=0x7f50c40a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50c40ab780 0x7f50c40a6350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f50c41361f0 tx=0x7f50b4015000).stop 2020-07-16T20:30:57.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c37fe700 1 -- 172.21.15.157:0/1251065079 reap_dead start 2020-07-16T20:30:57.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 shutdown_connections 2020-07-16T20:30:57.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 --2- 172.21.15.157:0/1251065079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50c40ab780 0x7f50c40a6350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 >> 172.21.15.157:0/1251065079 conn(0x7f50c4061820 msgr2=0x7f50c412eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 shutdown_connections 2020-07-16T20:30:57.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.349+0000 7f50c9a45700 1 -- 172.21.15.157:0/1251065079 wait complete. 2020-07-16T20:30:57.361 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:57.362 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-07-16T20:30:57.474 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.473+0000 7f16acf52700 1 Processor -- start 2020-07-16T20:30:57.475 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.473+0000 7f16acf52700 1 -- start start 2020-07-16T20:30:57.483 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f16a80a48e0 0x7f16a80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f16a80a7fb0 0x7f16a80a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f16a80ab780 0x7f16a80abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80a5450 con 0x7f16a80a7fb0 2020-07-16T20:30:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80a8950 con 0x7f16a80ab780 2020-07-16T20:30:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80a7880 con 0x7f16a80a48e0 2020-07-16T20:30:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f16a80ab780 0x7f16a80abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f16a80ab780 0x7f16a80abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33932/0 (socket says 172.21.15.157:33932) 2020-07-16T20:30:57.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 -- 172.21.15.157:0/3899126358 learned_addr learned my addr 172.21.15.157:0/3899126358 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.486 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a659c700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f16a80a48e0 0x7f16a80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a5d9b700 1 --2- 172.21.15.157:0/3899126358 >> v2:172.21.15.41:3300/0 conn(0x7f16a80a7fb0 0x7f16a80a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 -- 172.21.15.157:0/3899126358 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f16a80a48e0 msgr2=0x7f16a80a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f16a80a48e0 0x7f16a80a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 -- 172.21.15.157:0/3899126358 >> v2:172.21.15.41:3300/0 conn(0x7f16a80a7fb0 msgr2=0x7f16a80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 --2- 172.21.15.157:0/3899126358 >> v2:172.21.15.41:3300/0 conn(0x7f16a80a7fb0 0x7f16a80a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 -- 172.21.15.157:0/3899126358 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80a56b0 con 0x7f16a80ab780 2020-07-16T20:30:57.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a6d9d700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a80ab780 0x7f16a80abbf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1698002f30 tx=0x7f1698006e90).ready entity=mon.1 client_cookie=1a7d090823c452c8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a559a700 1 -- 172.21.15.157:0/3899126358 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1698009730 con 0x7f16a80ab780 2020-07-16T20:30:57.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a559a700 1 -- 172.21.15.157:0/3899126358 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698009890 con 0x7f16a80ab780 2020-07-16T20:30:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16a559a700 1 -- 172.21.15.157:0/3899126358 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1698009bf0 con 0x7f16a80ab780 2020-07-16T20:30:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 -- 172.21.15.157:0/3899126358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a80ab780 msgr2=0x7f16a80abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.474+0000 7f16acf52700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a80ab780 0x7f16a80abbf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1698002f30 tx=0x7f1698006e90).stop 2020-07-16T20:30:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 -- 172.21.15.157:0/3899126358 shutdown_connections 2020-07-16T20:30:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f16a80a48e0 0x7f16a80a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 --2- 172.21.15.157:0/3899126358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16a80ab780 0x7f16a80abbf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 --2- 172.21.15.157:0/3899126358 >> v2:172.21.15.41:3300/0 conn(0x7f16a80a7fb0 0x7f16a80a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 -- 172.21.15.157:0/3899126358 >> 172.21.15.157:0/3899126358 conn(0x7f16a8061820 msgr2=0x7f16a809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 -- 172.21.15.157:0/3899126358 shutdown_connections 2020-07-16T20:30:57.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.475+0000 7f16acf52700 1 -- 172.21.15.157:0/3899126358 wait complete. 2020-07-16T20:30:57.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.476+0000 7f16acf52700 1 Processor -- start 2020-07-16T20:30:57.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.476+0000 7f16acf52700 1 -- start start 2020-07-16T20:30:57.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16acf52700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f16a80a48e0 0x7f16a80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16acf52700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a81352c0 con 0x7f16a80a7fb0 2020-07-16T20:30:57.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16acf52700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8135fb0 con 0x7f16a80a2410 2020-07-16T20:30:57.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16acf52700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a81354f0 con 0x7f16a80a48e0 2020-07-16T20:30:57.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a6d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f16a80a2410 0x7f16a81516c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36626/0 (socket says 172.21.15.157:36626) 2020-07-16T20:30:57.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a6d9d700 1 -- 172.21.15.157:0/2036829419 learned_addr learned my addr 172.21.15.157:0/2036829419 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a659c700 1 --2- 172.21.15.157:0/2036829419 >> v2:172.21.15.41:3300/0 conn(0x7f16a80a48e0 0x7f16a80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256915397 0 0) 0x7f16a8135fb0 con 0x7f16a80a2410 2020-07-16T20:30:57.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1684003240 con 0x7f16a80a2410 2020-07-16T20:30:57.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a659c700 1 -- 172.21.15.157:0/2036829419 >> v1:172.21.15.157:6789/0 conn(0x7f16a80a2410 legacy=0x7f16a81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4120335847 0 0) 0x7f1684003240 con 0x7f16a80a2410 2020-07-16T20:30:57.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a659c700 1 -- 172.21.15.157:0/2036829419 >> v1:172.21.15.41:6789/0 conn(0x7f16a80a7fb0 legacy=0x7f16a80a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a659c700 1 -- 172.21.15.157:0/2036829419 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80a96c0 con 0x7f16a80a48e0 2020-07-16T20:30:57.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.477+0000 7f16a659c700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f16a80a48e0 0x7f16a80a9b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f169800b870 tx=0x7f16a00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1698009730 con 0x7f16a80a48e0 2020-07-16T20:30:57.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000c990 con 0x7f16a80a48e0 2020-07-16T20:30:57.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a000cb00 con 0x7f16a80a48e0 2020-07-16T20:30:57.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8134e20 con 0x7f16a80a48e0 2020-07-16T20:30:57.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8134420 con 0x7f16a80a48e0 2020-07-16T20:30:57.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.478+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16a8057490 con 0x7f16a80a48e0 2020-07-16T20:30:57.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f16a0022070 con 0x7f16a80a48e0 2020-07-16T20:30:57.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1684050270 0x7f1684052730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f16a0067ef0 con 0x7f16a80a48e0 2020-07-16T20:30:57.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f16a5d9b700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1684050270 0x7f1684052730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7f1684057c60 0x7f168405a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 --> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f168405a6d0 con 0x7f1684057c60 2020-07-16T20:30:57.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.479+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16a006a440 con 0x7f16a80a48e0 2020-07-16T20:30:57.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.480+0000 7f16a6d9d700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7f1684057c60 0x7f168405a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.480+0000 7f16a5d9b700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1684050270 0x7f1684052730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1690002f30 tx=0x7f1690006dd0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.480+0000 7f16a6d9d700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7f1684057c60 0x7f168405a080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.504 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.481+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== osd.3 v2:172.21.15.157:6826/23750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f168405a6d0 con 0x7f1684057c60 2020-07-16T20:30:57.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.498+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 --> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16a80a9880 con 0x7f1684057c60 2020-07-16T20:30:57.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f169e7fc700 1 -- 172.21.15.157:0/2036829419 <== osd.3 v2:172.21.15.157:6826/23750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16a80a9880 con 0x7f1684057c60 2020-07-16T20:30:57.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7f1684057c60 msgr2=0x7f168405a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7f1684057c60 0x7f168405a080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1684050270 msgr2=0x7f1684052730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1684050270 0x7f1684052730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1690002f30 tx=0x7f1690006dd0).stop 2020-07-16T20:30:57.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f16a80a48e0 msgr2=0x7f16a80a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f16a80a48e0 0x7f16a80a9b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f169800b870 tx=0x7f16a00091d0).stop 2020-07-16T20:30:57.509 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16a6d9d700 1 -- 172.21.15.157:0/2036829419 reap_dead start 2020-07-16T20:30:57.509 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 shutdown_connections 2020-07-16T20:30:57.509 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 --2- 172.21.15.157:0/2036829419 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f16a80a48e0 0x7f16a80a9b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 >> 172.21.15.157:0/2036829419 conn(0x7f16a8061820 msgr2=0x7f16a805bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 shutdown_connections 2020-07-16T20:30:57.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.499+0000 7f16acf52700 1 -- 172.21.15.157:0/2036829419 wait complete. 2020-07-16T20:30:57.512 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:30:57.512 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-07-16T20:30:57.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.621+0000 7f5afbfff700 1 Processor -- start 2020-07-16T20:30:57.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.621+0000 7f5afbfff700 1 -- start start 2020-07-16T20:30:57.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 0x7f5afc0a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afbfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc068260 con 0x7f5afc0a2ed0 2020-07-16T20:30:57.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afbfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc067b20 con 0x7f5afc0a7290 2020-07-16T20:30:57.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afbfff700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc067dc0 con 0x7f5afc133650 2020-07-16T20:30:57.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afaffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5afc0a7290 0x7f5afc09ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36632/0 (socket says 172.21.15.157:36632) 2020-07-16T20:30:57.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afaffd700 1 -- 172.21.15.157:0/652634135 learned_addr learned my addr 172.21.15.157:0/652634135 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afb7fe700 1 --2- 172.21.15.157:0/652634135 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 0x7f5afc0a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19865534 0 0) 0x7f5afc067b20 con 0x7f5afc0a7290 2020-07-16T20:30:57.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5adc003240 con 0x7f5afc0a7290 2020-07-16T20:30:57.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295394047 0 0) 0x7f5afc068260 con 0x7f5afc0a2ed0 2020-07-16T20:30:57.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc067b20 con 0x7f5afc0a2ed0 2020-07-16T20:30:57.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3131400413 0 0) 0x7f5adc003240 con 0x7f5afc0a7290 2020-07-16T20:30:57.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afb7fe700 1 -- 172.21.15.157:0/652634135 >> v1:172.21.15.157:6789/0 conn(0x7f5afc0a7290 legacy=0x7f5afc09ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afb7fe700 1 -- 172.21.15.157:0/652634135 >> v1:172.21.15.41:6789/0 conn(0x7f5afc0a2ed0 legacy=0x7f5afc132f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afb7fe700 1 -- 172.21.15.157:0/652634135 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0a7670 con 0x7f5afc133650 2020-07-16T20:30:57.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.622+0000 7f5afb7fe700 1 --2- 172.21.15.157:0/652634135 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 0x7f5afc0a3330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5aec0010d0 tx=0x7f5af40091d0).ready entity=mon.2 client_cookie=6a7fb043a01d337f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec0016d0 con 0x7f5afc133650 2020-07-16T20:30:57.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b880 con 0x7f5afc133650 2020-07-16T20:30:57.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afa7fc700 1 -- 172.21.15.157:0/652634135 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af400b9f0 con 0x7f5afc133650 2020-07-16T20:30:57.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 -- 172.21.15.157:0/652634135 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 msgr2=0x7f5afc0a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 --2- 172.21.15.157:0/652634135 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 0x7f5afc0a3330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5aec0010d0 tx=0x7f5af40091d0).stop 2020-07-16T20:30:57.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 -- 172.21.15.157:0/652634135 shutdown_connections 2020-07-16T20:30:57.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 --2- 172.21.15.157:0/652634135 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc133650 0x7f5afc0a3330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 -- 172.21.15.157:0/652634135 >> 172.21.15.157:0/652634135 conn(0x7f5afc05b810 msgr2=0x7f5afc05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 -- 172.21.15.157:0/652634135 shutdown_connections 2020-07-16T20:30:57.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.623+0000 7f5afbfff700 1 -- 172.21.15.157:0/652634135 wait complete. 2020-07-16T20:30:57.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.624+0000 7f5afbfff700 1 Processor -- start 2020-07-16T20:30:57.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.624+0000 7f5afbfff700 1 -- start start 2020-07-16T20:30:57.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc0a2ed0 0x7f5afc0a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5afc0615c0 0x7f5afc14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc134ea0 con 0x7f5afc0a7290 2020-07-16T20:30:57.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc135140 con 0x7f5afc0615c0 2020-07-16T20:30:57.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc134b10 con 0x7f5afc0a2ed0 2020-07-16T20:30:57.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af3fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5afc0a7290 0x7f5afc133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36640/0 (socket says 172.21.15.157:36640) 2020-07-16T20:30:57.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af3fff700 1 -- 172.21.15.157:0/2831499888 learned_addr learned my addr 172.21.15.157:0/2831499888 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afaffd700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc0a2ed0 0x7f5afc0a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 --2- 172.21.15.157:0/2831499888 >> v2:172.21.15.41:3300/0 conn(0x7f5afc0615c0 0x7f5afc14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228754952 0 0) 0x7f5afc134ea0 con 0x7f5afc0a7290 2020-07-16T20:30:57.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad8003240 con 0x7f5afc0a7290 2020-07-16T20:30:57.641 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 -- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc0a2ed0 msgr2=0x7f5afc0a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5afc0a2ed0 0x7f5afc0a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 -- 172.21.15.157:0/2831499888 >> v1:172.21.15.157:6789/0 conn(0x7f5afc0a7290 legacy=0x7f5afc133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.642 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 -- 172.21.15.157:0/2831499888 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc134580 con 0x7f5afc0615c0 2020-07-16T20:30:57.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afb7fe700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc0615c0 0x7f5afc14a570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5aec0010d0 tx=0x7f5af4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af4020400 con 0x7f5afc0615c0 2020-07-16T20:30:57.643 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4020560 con 0x7f5afc0615c0 2020-07-16T20:30:57.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc139f70 con 0x7f5afc0615c0 2020-07-16T20:30:57.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af40208c0 con 0x7f5afc0615c0 2020-07-16T20:30:57.644 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.625+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc14aa60 con 0x7f5afc0615c0 2020-07-16T20:30:57.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.626+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5afc1354c0 con 0x7f5afc0615c0 2020-07-16T20:30:57.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5af401e070 con 0x7f5afc0615c0 2020-07-16T20:30:57.645 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5ad8050310 0x7f5ad80527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.646 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5af4068960 con 0x7f5afc0615c0 2020-07-16T20:30:57.646 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5afaffd700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5ad8050310 0x7f5ad80527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.647 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7f5ad8057d00 0x7f5ad805a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.647 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 --> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad805a770 con 0x7f5ad8057d00 2020-07-16T20:30:57.647 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af4068d20 con 0x7f5afc0615c0 2020-07-16T20:30:57.647 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5afaffd700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5ad8050310 0x7f5ad80527d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5aec00d000 tx=0x7f5aec000b80).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.647 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.627+0000 7f5af3fff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7f5ad8057d00 0x7f5ad805a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.648 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.628+0000 7f5af3fff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7f5ad8057d00 0x7f5ad805a120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.648 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.629+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== osd.4 v2:172.21.15.41:6800/23935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f5ae4012b80 con 0x7f5ad8057d00 2020-07-16T20:30:57.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.646+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 --> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5afc057490 con 0x7f5ad8057d00 2020-07-16T20:30:57.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5af2ffd700 1 -- 172.21.15.157:0/2831499888 <== osd.4 v2:172.21.15.41:6800/23935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5afc057490 con 0x7f5ad8057d00 2020-07-16T20:30:57.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7f5ad8057d00 msgr2=0x7f5ad805a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7f5ad8057d00 0x7f5ad805a120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5ad8050310 msgr2=0x7f5ad80527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5ad8050310 0x7f5ad80527d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5aec00d000 tx=0x7f5aec000b80).stop 2020-07-16T20:30:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc0615c0 msgr2=0x7f5afc14a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc0615c0 0x7f5afc14a570 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5aec0010d0 tx=0x7f5af4016000).stop 2020-07-16T20:30:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afb7fe700 1 -- 172.21.15.157:0/2831499888 reap_dead start 2020-07-16T20:30:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 shutdown_connections 2020-07-16T20:30:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 --2- 172.21.15.157:0/2831499888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc0615c0 0x7f5afc14a570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 >> 172.21.15.157:0/2831499888 conn(0x7f5afc05b810 msgr2=0x7f5afc132d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 shutdown_connections 2020-07-16T20:30:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.647+0000 7f5afbfff700 1 -- 172.21.15.157:0/2831499888 wait complete. 2020-07-16T20:30:57.658 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:57.659 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-07-16T20:30:57.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.767+0000 7f615579b700 1 Processor -- start 2020-07-16T20:30:57.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.767+0000 7f615579b700 1 -- start start 2020-07-16T20:30:57.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f61500ac240 0x7f6150135900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500a3d00 con 0x7f6150135df0 2020-07-16T20:30:57.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500a4320 con 0x7f6150132f70 2020-07-16T20:30:57.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6150136280 con 0x7f61500ac240 2020-07-16T20:30:57.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f61500ac240 0x7f6150135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.773 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6150132f70 0x7f6150140270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36652/0 (socket says 172.21.15.157:36652) 2020-07-16T20:30:57.773 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614f7fe700 1 -- 172.21.15.157:0/3893553623 learned_addr learned my addr 172.21.15.157:0/3893553623 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.773 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614effd700 1 -- 172.21.15.157:0/3893553623 >> v1:172.21.15.157:6789/0 conn(0x7f6150132f70 legacy=0x7f6150140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.773 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614effd700 1 -- 172.21.15.157:0/3893553623 >> v1:172.21.15.41:6789/0 conn(0x7f6150135df0 legacy=0x7f6150132860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.774 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614dffb700 1 -- 172.21.15.157:0/3893553623 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269522005 0 0) 0x7f61500a4320 con 0x7f6150132f70 2020-07-16T20:30:57.774 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614effd700 1 -- 172.21.15.157:0/3893553623 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500a45c0 con 0x7f61500ac240 2020-07-16T20:30:57.774 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614effd700 1 --2- 172.21.15.157:0/3893553623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61500ac240 0x7f6150135900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6150133490 tx=0x7f6144006dd0).ready entity=mon.1 client_cookie=cbfda67dc38a8cb server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.774 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614dffb700 1 -- 172.21.15.157:0/3893553623 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61440097b0 con 0x7f61500ac240 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614dffb700 1 -- 172.21.15.157:0/3893553623 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144009910 con 0x7f61500ac240 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f614dffb700 1 -- 172.21.15.157:0/3893553623 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6144009c70 con 0x7f61500ac240 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- 172.21.15.157:0/3893553623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61500ac240 msgr2=0x7f6150135900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 --2- 172.21.15.157:0/3893553623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61500ac240 0x7f6150135900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6150133490 tx=0x7f6144006dd0).stop 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- 172.21.15.157:0/3893553623 shutdown_connections 2020-07-16T20:30:57.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 --2- 172.21.15.157:0/3893553623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61500ac240 0x7f6150135900 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.768+0000 7f615579b700 1 -- 172.21.15.157:0/3893553623 >> 172.21.15.157:0/3893553623 conn(0x7f6150061820 msgr2=0x7f615009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.769+0000 7f615579b700 1 -- 172.21.15.157:0/3893553623 shutdown_connections 2020-07-16T20:30:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.769+0000 7f615579b700 1 -- 172.21.15.157:0/3893553623 wait complete. 2020-07-16T20:30:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.770+0000 7f615579b700 1 Processor -- start 2020-07-16T20:30:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.770+0000 7f615579b700 1 -- start start 2020-07-16T20:30:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6150132f70 0x7f61500a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f615013ae50 0x7f615012fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615013b2f0 con 0x7f6150135df0 2020-07-16T20:30:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615013b590 con 0x7f615013ae50 2020-07-16T20:30:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6150144ce0 con 0x7f6150132f70 2020-07-16T20:30:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6150132f70 0x7f61500a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614e7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6150135df0 0x7f61501451f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36656/0 (socket says 172.21.15.157:36656) 2020-07-16T20:30:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6150132f70 0x7f61500a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33966/0 (socket says 172.21.15.157:33966) 2020-07-16T20:30:57.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614e7fc700 1 -- 172.21.15.157:0/980270671 learned_addr learned my addr 172.21.15.157:0/980270671 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:57.790 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614f7fe700 1 --2- 172.21.15.157:0/980270671 >> v2:172.21.15.41:3300/0 conn(0x7f615013ae50 0x7f615012fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.790 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 -- 172.21.15.157:0/980270671 >> v2:172.21.15.41:3300/0 conn(0x7f615013ae50 msgr2=0x7f615012fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 --2- 172.21.15.157:0/980270671 >> v2:172.21.15.41:3300/0 conn(0x7f615013ae50 0x7f615012fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 -- 172.21.15.157:0/980270671 >> v1:172.21.15.157:6789/0 conn(0x7f6150135df0 legacy=0x7f61501451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187322583 0 0) 0x7f615013b2f0 con 0x7f6150135df0 2020-07-16T20:30:57.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 -- 172.21.15.157:0/980270671 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615013df20 con 0x7f6150132f70 2020-07-16T20:30:57.791 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f614effd700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6150132f70 0x7f61500a16a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f615013ad60 tx=0x7f6144015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6144006240 con 0x7f6150132f70 2020-07-16T20:30:57.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61440063a0 con 0x7f6150132f70 2020-07-16T20:30:57.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500a1d30 con 0x7f6150132f70 2020-07-16T20:30:57.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61440056d0 con 0x7f6150132f70 2020-07-16T20:30:57.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.771+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150145b40 con 0x7f6150132f70 2020-07-16T20:30:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.772+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f615013a0b0 con 0x7f6150132f70 2020-07-16T20:30:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.772+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f614401a040 con 0x7f6150132f70 2020-07-16T20:30:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.772+0000 7f6136ffd700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f612c04fe30 0x7f612c0522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6144068ed0 con 0x7f6150132f70 2020-07-16T20:30:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f614e7fc700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f612c04fe30 0x7f612c0522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f6136ffd700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f612c0579a0 0x7f612c059dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 --> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f612c05a410 con 0x7f612c0579a0 2020-07-16T20:30:57.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f614406b540 con 0x7f6150132f70 2020-07-16T20:30:57.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f614e7fc700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f612c04fe30 0x7f612c0522f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6140000ec0 tx=0x7f6140001610).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.795 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f614f7fe700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f612c0579a0 0x7f612c059dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.795 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.773+0000 7f614f7fe700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f612c0579a0 0x7f612c059dc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.795 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.774+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== osd.5 v2:172.21.15.41:6816/23951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f612c05a410 con 0x7f612c0579a0 2020-07-16T20:30:57.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.791+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 --> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6150057490 con 0x7f612c0579a0 2020-07-16T20:30:57.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.792+0000 7f6136ffd700 1 -- 172.21.15.157:0/980270671 <== osd.5 v2:172.21.15.41:6816/23951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6150057490 con 0x7f612c0579a0 2020-07-16T20:30:57.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.792+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f612c0579a0 msgr2=0x7f612c059dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.792+0000 7f615579b700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f612c0579a0 0x7f612c059dc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f612c04fe30 msgr2=0x7f612c0522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f612c04fe30 0x7f612c0522f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6140000ec0 tx=0x7f6140001610).stop 2020-07-16T20:30:57.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6150132f70 msgr2=0x7f61500a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6150132f70 0x7f61500a16a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f615013ad60 tx=0x7f6144015000).stop 2020-07-16T20:30:57.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f614f7fe700 1 -- 172.21.15.157:0/980270671 reap_dead start 2020-07-16T20:30:57.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 shutdown_connections 2020-07-16T20:30:57.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 --2- 172.21.15.157:0/980270671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6150132f70 0x7f61500a16a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 >> 172.21.15.157:0/980270671 conn(0x7f6150061820 msgr2=0x7f615005bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.803 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 shutdown_connections 2020-07-16T20:30:57.803 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.793+0000 7f615579b700 1 -- 172.21.15.157:0/980270671 wait complete. 2020-07-16T20:30:57.804 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:30:57.805 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-07-16T20:30:57.913 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.911+0000 7fd4d201a700 1 Processor -- start 2020-07-16T20:30:57.914 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 -- start start 2020-07-16T20:30:57.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc09ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 0x7fd4cc1333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc068260 con 0x7fd4cc0a7290 2020-07-16T20:30:57.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc067b20 con 0x7fd4cc0a2ed0 2020-07-16T20:30:57.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d201a700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc067dc0 con 0x7fd4cc132f40 2020-07-16T20:30:57.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d0817700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d0817700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33976/0 (socket says 172.21.15.157:33976) 2020-07-16T20:30:57.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.912+0000 7fd4d0817700 1 -- 172.21.15.157:0/3883606163 learned_addr learned my addr 172.21.15.157:0/3883606163 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d1018700 1 --2- 172.21.15.157:0/3883606163 >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc09ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d1819700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 0x7fd4cc1333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 -- 172.21.15.157:0/3883606163 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 msgr2=0x7fd4cc1333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 0x7fd4cc1333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 -- 172.21.15.157:0/3883606163 >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 msgr2=0x7fd4cc09ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:57.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 --2- 172.21.15.157:0/3883606163 >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc09ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 -- 172.21.15.157:0/3883606163 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc0a7670 con 0x7fd4cc0a2ed0 2020-07-16T20:30:57.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d1819700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 0x7fd4cc1333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:57.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d0817700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd4c8002f30 tx=0x7fd4c8006e90).ready entity=mon.1 client_cookie=c0e88845c0f64af4 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4bbfff700 1 -- 172.21.15.157:0/3883606163 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8009920 con 0x7fd4cc0a2ed0 2020-07-16T20:30:57.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4bbfff700 1 -- 172.21.15.157:0/3883606163 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8009a80 con 0x7fd4cc0a2ed0 2020-07-16T20:30:57.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4bbfff700 1 -- 172.21.15.157:0/3883606163 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8009de0 con 0x7fd4cc0a2ed0 2020-07-16T20:30:57.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 -- 172.21.15.157:0/3883606163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4cc0a2ed0 msgr2=0x7fd4cc0a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd4c8002f30 tx=0x7fd4c8006e90).stop 2020-07-16T20:30:57.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 -- 172.21.15.157:0/3883606163 shutdown_connections 2020-07-16T20:30:57.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc132f40 0x7fd4cc1333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.934 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3883606163 >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc09ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.934 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3883606163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4cc0a2ed0 0x7fd4cc0a3330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 -- 172.21.15.157:0/3883606163 >> 172.21.15.157:0/3883606163 conn(0x7fd4cc05b810 msgr2=0x7fd4cc05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 -- 172.21.15.157:0/3883606163 shutdown_connections 2020-07-16T20:30:57.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.913+0000 7fd4d201a700 1 -- 172.21.15.157:0/3883606163 wait complete. 2020-07-16T20:30:57.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 Processor -- start 2020-07-16T20:30:57.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 -- start start 2020-07-16T20:30:57.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc067260 0x7fd4cc12e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc064a80 con 0x7fd4cc132f40 2020-07-16T20:30:57.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc0628a0 con 0x7fd4cc0a7290 2020-07-16T20:30:57.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.915+0000 7fd4d201a700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc067840 con 0x7fd4cc067260 2020-07-16T20:30:57.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1819700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc067260 0x7fd4cc12e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0a7290 0x7fd4cc062d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:59220/0 (socket says 172.21.15.157:59220) 2020-07-16T20:30:57.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 -- 172.21.15.157:0/3877100837 learned_addr learned my addr 172.21.15.157:0/3877100837 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:57.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1819700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc067260 0x7fd4cc12e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:59324/0 (socket says 172.21.15.157:59324) 2020-07-16T20:30:57.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 -- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc067260 msgr2=0x7fd4cc12e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd4cc067260 0x7fd4cc12e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 -- 172.21.15.157:0/3877100837 >> v1:172.21.15.41:6789/0 conn(0x7fd4cc132f40 legacy=0x7fd4cc12dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 -- 172.21.15.157:0/3877100837 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc067980 con 0x7fd4cc0a7290 2020-07-16T20:30:57.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d1018700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0a7290 0x7fd4cc062d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd4bc003070 tx=0x7fd4bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc009790 con 0x7fd4cc0a7290 2020-07-16T20:30:57.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0098f0 con 0x7fd4cc0a7290 2020-07-16T20:30:57.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc0a2030 con 0x7fd4cc0a7290 2020-07-16T20:30:57.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc009c50 con 0x7fd4cc0a7290 2020-07-16T20:30:57.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.916+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc136420 con 0x7fd4cc0a7290 2020-07-16T20:30:57.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.917+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4cc136640 con 0x7fd4cc0a7290 2020-07-16T20:30:57.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.917+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd4bc013480 con 0x7fd4cc0a7290 2020-07-16T20:30:57.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4b97fa700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd4a404ffb0 0x7fd4a4052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.945 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd4bc068310 con 0x7fd4cc0a7290 2020-07-16T20:30:57.945 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4d0817700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd4a404ffb0 0x7fd4a4052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.946 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4b97fa700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7fd4a4057ba0 0x7fd4a4059fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:57.946 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 --> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4a405a610 con 0x7fd4a4057ba0 2020-07-16T20:30:57.946 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4bc06a980 con 0x7fd4cc0a7290 2020-07-16T20:30:57.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4d0817700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd4a404ffb0 0x7fd4a4052470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd4cc0a1f60 tx=0x7fd4c8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4d1819700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7fd4a4057ba0 0x7fd4a4059fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:57.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.918+0000 7fd4d1819700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7fd4a4057ba0 0x7fd4a4059fc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:57.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.919+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== osd.6 v2:172.21.15.41:6808/23936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fd4a405a610 con 0x7fd4a4057ba0 2020-07-16T20:30:57.951 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.936+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 --> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4cc067980 con 0x7fd4a4057ba0 2020-07-16T20:30:57.951 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4b97fa700 1 -- 172.21.15.157:0/3877100837 <== osd.6 v2:172.21.15.41:6808/23936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4cc067980 con 0x7fd4a4057ba0 2020-07-16T20:30:57.951 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7fd4a4057ba0 msgr2=0x7fd4a4059fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.952 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7fd4a4057ba0 0x7fd4a4059fc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.952 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd4a404ffb0 msgr2=0x7fd4a4052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.953 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd4a404ffb0 0x7fd4a4052470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd4cc0a1f60 tx=0x7fd4c8015000).stop 2020-07-16T20:30:57.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0a7290 msgr2=0x7fd4cc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:57.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0a7290 0x7fd4cc062d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd4bc003070 tx=0x7fd4bc008040).stop 2020-07-16T20:30:57.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d1819700 1 -- 172.21.15.157:0/3877100837 reap_dead start 2020-07-16T20:30:57.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 shutdown_connections 2020-07-16T20:30:57.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 --2- 172.21.15.157:0/3877100837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0a7290 0x7fd4cc062d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:57.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 >> 172.21.15.157:0/3877100837 conn(0x7fd4cc05b810 msgr2=0x7fd4cc0a9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:57.956 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 shutdown_connections 2020-07-16T20:30:57.956 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:57.938+0000 7fd4d201a700 1 -- 172.21.15.157:0/3877100837 wait complete. 2020-07-16T20:30:57.956 INFO:teuthology.orchestra.run.smithi157.stdout:55834574855 2020-07-16T20:30:57.957 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-07-16T20:30:58.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 Processor -- start 2020-07-16T20:30:58.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 -- start start 2020-07-16T20:30:58.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fb80a48e0 0x7f6fb80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6fb80a7fb0 0x7f6fb80a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb80a5450 con 0x7f6fb80ab780 2020-07-16T20:30:58.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80a7880 con 0x7f6fb80a48e0 2020-07-16T20:30:58.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.064+0000 7f6fbf6bd700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80a8930 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fb80a48e0 0x7f6fb80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbdc5a700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6fb80ab780 0x7f6fb80abbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36678/0 (socket says 172.21.15.157:36678) 2020-07-16T20:30:58.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbdc5a700 1 -- 172.21.15.157:0/3731237312 learned_addr learned my addr 172.21.15.157:0/3731237312 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:58.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbcc58700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6fb80a7fb0 0x7f6fb80a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 -- 172.21.15.157:0/3731237312 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6fb80a7fb0 msgr2=0x7f6fb80a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:58.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6fb80a7fb0 0x7f6fb80a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 -- 172.21.15.157:0/3731237312 >> v1:172.21.15.157:6789/0 conn(0x7f6fb80ab780 legacy=0x7f6fb80abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 -- 172.21.15.157:0/3731237312 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80a56b0 con 0x7f6fb80a48e0 2020-07-16T20:30:58.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fabfff700 1 -- 172.21.15.157:0/3731237312 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173889518 0 0) 0x7f6fb80a5450 con 0x7f6fb80ab780 2020-07-16T20:30:58.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbd459700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fb80a48e0 0x7f6fb80a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6fb00032b0 tx=0x7f6fb00091d0).ready entity=mon.1 client_cookie=203ca1a1583cbfe7 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fabfff700 1 -- 172.21.15.157:0/3731237312 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000b9a0 con 0x7f6fb80a48e0 2020-07-16T20:30:58.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fabfff700 1 -- 172.21.15.157:0/3731237312 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000bb00 con 0x7f6fb80a48e0 2020-07-16T20:30:58.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fabfff700 1 -- 172.21.15.157:0/3731237312 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000bc70 con 0x7f6fb80a48e0 2020-07-16T20:30:58.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/3731237312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fb80a48e0 msgr2=0x7f6fb80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fb80a48e0 0x7f6fb80a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6fb00032b0 tx=0x7f6fb00091d0).stop 2020-07-16T20:30:58.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/3731237312 shutdown_connections 2020-07-16T20:30:58.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fb80a48e0 0x7f6fb80a4cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/3731237312 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6fb80a7fb0 0x7f6fb80a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/3731237312 >> 172.21.15.157:0/3731237312 conn(0x7f6fb8061820 msgr2=0x7f6fb809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:58.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/3731237312 shutdown_connections 2020-07-16T20:30:58.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.065+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/3731237312 wait complete. 2020-07-16T20:30:58.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 Processor -- start 2020-07-16T20:30:58.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 -- start start 2020-07-16T20:30:58.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6fb81387f0 0x7f6fb81398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb8067dc0 con 0x7f6fb80ab780 2020-07-16T20:30:58.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb8068060 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.067+0000 7f6fbf6bd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb81390e0 con 0x7f6fb81387f0 2020-07-16T20:30:58.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6fb80a7fb0 0x7f6fb81380e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36682/0 (socket says 172.21.15.157:36682) 2020-07-16T20:30:58.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 -- 172.21.15.157:0/526447905 learned_addr learned my addr 172.21.15.157:0/526447905 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:58.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> v2:172.21.15.41:3300/0 conn(0x7f6fb81387f0 0x7f6fb81398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54842374 0 0) 0x7f6fb8068060 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f90003240 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3014497239 0 0) 0x7f6f90003240 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6fb8068060 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f6fb000b9a0 con 0x7f6fb80a7fb0 2020-07-16T20:30:58.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 >> v2:172.21.15.41:3300/0 conn(0x7f6fb81387f0 msgr2=0x7f6fb81398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> v2:172.21.15.41:3300/0 conn(0x7f6fb81387f0 0x7f6fb81398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 >> v1:172.21.15.157:6789/0 conn(0x7f6fb80a7fb0 legacy=0x7f6fb81380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 >> v1:172.21.15.41:6789/0 conn(0x7f6fb80ab780 legacy=0x7f6fb812d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 0x7f6f90003be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f900044e0 0x7f6f90004940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f90004e30 0x7f6f9000b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81390e0 con 0x7f6f90004e30 2020-07-16T20:30:58.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90004250 con 0x7f6f90003800 2020-07-16T20:30:58.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9000bc20 con 0x7f6f900044e0 2020-07-16T20:30:58.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> v2:172.21.15.41:3300/0 conn(0x7f6fb81387f0 0x7f6fb81398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:58.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 0x7f6f90003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbcc58700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f900044e0 0x7f6f90004940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f90004e30 0x7f6f9000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 -- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f900044e0 msgr2=0x7f6f90004940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f900044e0 0x7f6f90004940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 -- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f90004e30 msgr2=0x7f6f9000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f90004e30 0x7f6f9000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbd459700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80677a0 con 0x7f6f90003800 2020-07-16T20:30:58.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80a1c00 con 0x7f6f90003800 2020-07-16T20:30:58.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.068+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f90004e30 0x7f6f9000b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:58.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fbdc5a700 1 -- 172.21.15.157:0/526447905 reap_dead start 2020-07-16T20:30:58.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb80a2070 con 0x7f6f90003800 2020-07-16T20:30:58.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fbd459700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 0x7f6f90003be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6fb0006ca0 tx=0x7f6fb0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb001f430 con 0x7f6f90003800 2020-07-16T20:30:58.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb001f590 con 0x7f6f90003800 2020-07-16T20:30:58.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb001f8f0 con 0x7f6f90003800 2020-07-16T20:30:58.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.069+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fb8057490 con 0x7f6f90003800 2020-07-16T20:30:58.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6fb000f070 con 0x7f6f90003800 2020-07-16T20:30:58.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 0x7f6f90056120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6fb0069ae0 con 0x7f6f90003800 2020-07-16T20:30:58.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fbcc58700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 0x7f6f90056120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 0x7f6f9005da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f9005e0d0 con 0x7f6f9005b660 2020-07-16T20:30:58.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb0069e00 con 0x7f6f90003800 2020-07-16T20:30:58.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.070+0000 7f6fbcc58700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 0x7f6f90056120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6fac00e000 tx=0x7f6fac006dd0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.071+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 0x7f6f9005da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.071+0000 7f6fbdc5a700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 0x7f6f9005da80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.072+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== osd.7 v2:172.21.15.41:6817/23952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f6f9005e0d0 con 0x7f6f9005b660 2020-07-16T20:30:58.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.089+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 --> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fb80a2c30 con 0x7f6f9005b660 2020-07-16T20:30:58.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fa97fa700 1 -- 172.21.15.157:0/526447905 <== osd.7 v2:172.21.15.41:6817/23952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fb80a2c30 con 0x7f6f9005b660 2020-07-16T20:30:58.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 msgr2=0x7f6f9005da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 0x7f6f9005da80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 msgr2=0x7f6f90056120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 0x7f6f90056120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6fac00e000 tx=0x7f6fac006dd0).stop 2020-07-16T20:30:58.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 msgr2=0x7f6f90003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 0x7f6f90003be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6fb0006ca0 tx=0x7f6fb0016000).stop 2020-07-16T20:30:58.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 shutdown_connections 2020-07-16T20:30:58.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7f6f9005b660 0x7f6f9005da80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f90053c60 0x7f6f90056120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 --2- 172.21.15.157:0/526447905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90003800 0x7f6f90003be0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 >> 172.21.15.157:0/526447905 conn(0x7f6fb8061820 msgr2=0x7f6fb8136210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 shutdown_connections 2020-07-16T20:30:58.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.090+0000 7f6fbf6bd700 1 -- 172.21.15.157:0/526447905 wait complete. 2020-07-16T20:30:58.101 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:58.102 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-07-16T20:30:58.209 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.207+0000 7fe3be875700 1 Processor -- start 2020-07-16T20:30:58.209 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.207+0000 7fe3be875700 1 -- start start 2020-07-16T20:30:58.211 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3be875700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a37d0 0x7fe3b80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3be875700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3b80a5870 0x7fe3b8148230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3be875700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80a6190 con 0x7fe3b8140e90 2020-07-16T20:30:58.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3be875700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b8141270 con 0x7fe3b80a37d0 2020-07-16T20:30:58.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3be875700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80abfe0 con 0x7fe3b80a5870 2020-07-16T20:30:58.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a37d0 0x7fe3b80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe3b8140e90 0x7fe3b80ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50278/0 (socket says 172.21.15.157:50278) 2020-07-16T20:30:58.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b7fff700 1 -- 172.21.15.157:0/3735733473 learned_addr learned my addr 172.21.15.157:0/3735733473 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:58.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3bce12700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3b80a5870 0x7fe3b8148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 -- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3b80a5870 msgr2=0x7fe3b8148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:58.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 --2- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3b80a5870 0x7fe3b8148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 -- 172.21.15.157:0/3735733473 >> v1:172.21.15.41:6789/0 conn(0x7fe3b8140e90 legacy=0x7fe3b80ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 -- 172.21.15.157:0/3735733473 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80a63f0 con 0x7fe3b80a37d0 2020-07-16T20:30:58.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.208+0000 7fe3b77fe700 1 --2- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3b80a37d0 0x7fe3b80a5380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe3ac002f30 tx=0x7fe3ac006dd0).ready entity=mon.0 client_cookie=124ce57123a37a16 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3b6ffd700 1 -- 172.21.15.157:0/3735733473 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac009760 con 0x7fe3b80a37d0 2020-07-16T20:30:58.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3b6ffd700 1 -- 172.21.15.157:0/3735733473 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac0098c0 con 0x7fe3b80a37d0 2020-07-16T20:30:58.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3b6ffd700 1 -- 172.21.15.157:0/3735733473 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac009c20 con 0x7fe3b80a37d0 2020-07-16T20:30:58.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 -- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3b80a37d0 msgr2=0x7fe3b80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 --2- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3b80a37d0 0x7fe3b80a5380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe3ac002f30 tx=0x7fe3ac006dd0).stop 2020-07-16T20:30:58.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 -- 172.21.15.157:0/3735733473 shutdown_connections 2020-07-16T20:30:58.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 --2- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe3b80a5870 0x7fe3b8148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 --2- 172.21.15.157:0/3735733473 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3b80a37d0 0x7fe3b80a5380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 -- 172.21.15.157:0/3735733473 >> 172.21.15.157:0/3735733473 conn(0x7fe3b8061820 msgr2=0x7fe3b809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:58.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 -- 172.21.15.157:0/3735733473 shutdown_connections 2020-07-16T20:30:58.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.209+0000 7fe3be875700 1 -- 172.21.15.157:0/3735733473 wait complete. 2020-07-16T20:30:58.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.210+0000 7fe3be875700 1 Processor -- start 2020-07-16T20:30:58.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.210+0000 7fe3be875700 1 -- start start 2020-07-16T20:30:58.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3be875700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a5870 0x7fe3b813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3be875700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3b8140e90 0x7fe3b8136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3be875700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b813bda0 con 0x7fe3b80a0a90 2020-07-16T20:30:58.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3be875700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b813e4a0 con 0x7fe3b80a5870 2020-07-16T20:30:58.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3be875700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b813df60 con 0x7fe3b8140e90 2020-07-16T20:30:58.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3b8140e90 0x7fe3b8136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3b8140e90 0x7fe3b8136df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34016/0 (socket says 172.21.15.157:34016) 2020-07-16T20:30:58.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 -- 172.21.15.157:0/931302671 learned_addr learned my addr 172.21.15.157:0/931302671 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:58.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b7fff700 1 --2- 172.21.15.157:0/931302671 >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a5870 0x7fe3b813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 -- 172.21.15.157:0/931302671 >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a5870 msgr2=0x7fe3b813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 --2- 172.21.15.157:0/931302671 >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a5870 0x7fe3b813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 -- 172.21.15.157:0/931302671 >> v1:172.21.15.41:6789/0 conn(0x7fe3b80a0a90 legacy=0x7fe3b813cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 -- 172.21.15.157:0/931302671 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b813e200 con 0x7fe3b8140e90 2020-07-16T20:30:58.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.211+0000 7fe3b77fe700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3b8140e90 0x7fe3b8136df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe3ac002f30 tx=0x7fe3ac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.212+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac021070 con 0x7fe3b8140e90 2020-07-16T20:30:58.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.212+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac01c730 con 0x7fe3b8140e90 2020-07-16T20:30:58.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.212+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b813d230 con 0x7fe3b8140e90 2020-07-16T20:30:58.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.212+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac01ca90 con 0x7fe3b8140e90 2020-07-16T20:30:58.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.212+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b8134680 con 0x7fe3b8140e90 2020-07-16T20:30:58.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b8057490 con 0x7fe3b8140e90 2020-07-16T20:30:58.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fe3ac00f070 con 0x7fe3b8140e90 2020-07-16T20:30:58.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe39ffff700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 0x7fe394052560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:58.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe3ac0693e0 con 0x7fe3b8140e90 2020-07-16T20:30:58.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe3b7fff700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 0x7fe394052560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:58.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.213+0000 7fe3b7fff700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 0x7fe394052560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe3a800d000 tx=0x7fe3a8007b80).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:58.226 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.216+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fe3ac041b70 con 0x7fe3b8140e90 2020-07-16T20:30:58.363 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.362+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3b8043fd0 con 0x7fe3b8140e90 2020-07-16T20:30:58.364 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.362+0000 7fe39ffff700 1 -- 172.21.15.157:0/931302671 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3ac045190 con 0x7fe3b8140e90 2020-07-16T20:30:58.364 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:58.365 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 msgr2=0x7fe394052560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.365 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 0x7fe394052560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe3a800d000 tx=0x7fe3a8007b80).stop 2020-07-16T20:30:58.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3b8140e90 msgr2=0x7fe3b8136df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:58.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3b8140e90 0x7fe3b8136df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe3ac002f30 tx=0x7fe3ac015000).stop 2020-07-16T20:30:58.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 shutdown_connections 2020-07-16T20:30:58.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe3940500a0 0x7fe394052560 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 --2- 172.21.15.157:0/931302671 >> v2:172.21.15.41:3300/0 conn(0x7fe3b80a5870 0x7fe3b813d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 --2- 172.21.15.157:0/931302671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3b8140e90 0x7fe3b8136df0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:58.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 >> 172.21.15.157:0/931302671 conn(0x7fe3b8061820 msgr2=0x7fe3b809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:58.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 shutdown_connections 2020-07-16T20:30:58.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:58.363+0000 7fe3be875700 1 -- 172.21.15.157:0/931302671 wait complete. 2020-07-16T20:30:58.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2020-07-16T20:30:58.750 INFO:tasks.ceph.mds.a.smithi157.stderr:2020-07-16T20:30:58.749+0000 7f7f96506700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-07-16T20:30:59.376 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-07-16T20:30:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.487+0000 7f544fc4e700 1 Processor -- start 2020-07-16T20:30:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 -- start start 2020-07-16T20:30:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f54480ac240 0x7f5448135900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f5448140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480a3d00 con 0x7f5448135df0 2020-07-16T20:30:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5448136280 con 0x7f54480ac240 2020-07-16T20:30:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544fc4e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480a4130 con 0x7f5448132f70 2020-07-16T20:30:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544d9ea700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f54480ac240 0x7f5448135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544d1e9700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5448135df0 0x7f5448132860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36712/0 (socket says 172.21.15.157:36712) 2020-07-16T20:30:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.488+0000 7f544d1e9700 1 -- 172.21.15.157:0/518948828 learned_addr learned my addr 172.21.15.157:0/518948828 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544d9ea700 1 -- 172.21.15.157:0/518948828 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 msgr2=0x7f5448140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544d9ea700 1 --2- 172.21.15.157:0/518948828 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f5448140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544c9e8700 1 -- 172.21.15.157:0/518948828 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087942183 0 0) 0x7f54480a3d00 con 0x7f5448135df0 2020-07-16T20:30:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544d9ea700 1 -- 172.21.15.157:0/518948828 >> v1:172.21.15.157:6789/0 conn(0x7f5448135df0 legacy=0x7f5448132860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544d9ea700 1 -- 172.21.15.157:0/518948828 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480a4320 con 0x7f54480ac240 2020-07-16T20:30:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544d9ea700 1 --2- 172.21.15.157:0/518948828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54480ac240 0x7f5448135900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5448133490 tx=0x7f5438006d60).ready entity=mon.1 client_cookie=1d05c749d8a6d8d0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544c9e8700 1 -- 172.21.15.157:0/518948828 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543800be90 con 0x7f54480ac240 2020-07-16T20:30:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544c9e8700 1 -- 172.21.15.157:0/518948828 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380153f0 con 0x7f54480ac240 2020-07-16T20:30:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544c9e8700 1 -- 172.21.15.157:0/518948828 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5438015750 con 0x7f54480ac240 2020-07-16T20:30:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 -- 172.21.15.157:0/518948828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54480ac240 msgr2=0x7f5448135900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 --2- 172.21.15.157:0/518948828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54480ac240 0x7f5448135900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5448133490 tx=0x7f5438006d60).stop 2020-07-16T20:30:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 -- 172.21.15.157:0/518948828 shutdown_connections 2020-07-16T20:30:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 --2- 172.21.15.157:0/518948828 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f5448140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:30:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 --2- 172.21.15.157:0/518948828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54480ac240 0x7f5448135900 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 -- 172.21.15.157:0/518948828 >> 172.21.15.157:0/518948828 conn(0x7f5448061820 msgr2=0x7f544809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 -- 172.21.15.157:0/518948828 shutdown_connections 2020-07-16T20:30:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.489+0000 7f544fc4e700 1 -- 172.21.15.157:0/518948828 wait complete. 2020-07-16T20:30:59.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.490+0000 7f544fc4e700 1 Processor -- start 2020-07-16T20:30:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 -- start start 2020-07-16T20:30:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f54481393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f54480670f0 0x7f54480aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5448067c30 con 0x7f5448135df0 2020-07-16T20:30:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480ab5f0 con 0x7f54480670f0 2020-07-16T20:30:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544fc4e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480ab890 con 0x7f5448132f70 2020-07-16T20:30:59.505 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544d9ea700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f54481393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544d1e9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5448135df0 0x7f54480669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50296/0 (socket says 172.21.15.157:50296) 2020-07-16T20:30:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544e1eb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f54480670f0 0x7f54480aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.491+0000 7f544d1e9700 1 -- 172.21.15.157:0/4021086338 learned_addr learned my addr 172.21.15.157:0/4021086338 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513519788 0 0) 0x7f5448067c30 con 0x7f5448135df0 2020-07-16T20:30:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5420003240 con 0x7f5448135df0 2020-07-16T20:30:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544e1eb700 1 -- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 msgr2=0x7f54481393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544e1eb700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f54481393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544e1eb700 1 -- 172.21.15.157:0/4021086338 >> v1:172.21.15.41:6789/0 conn(0x7f5448135df0 legacy=0x7f54480669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544e1eb700 1 -- 172.21.15.157:0/4021086338 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480665b0 con 0x7f54480670f0 2020-07-16T20:30:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544e1eb700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54480670f0 0x7f54480aaa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f54400032b0 tx=0x7f54400090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544000c830 con 0x7f54480670f0 2020-07-16T20:30:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000c990 con 0x7f54480670f0 2020-07-16T20:30:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54480ab0e0 con 0x7f54480670f0 2020-07-16T20:30:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.492+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544000ccf0 con 0x7f54480670f0 2020-07-16T20:30:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.493+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54480ab3c0 con 0x7f54480670f0 2020-07-16T20:30:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f544001c070 con 0x7f54480670f0 2020-07-16T20:30:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5448057490 con 0x7f54480670f0 2020-07-16T20:30:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f5435ffb700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 0x7f5420052830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5440067980 con 0x7f54480670f0 2020-07-16T20:30:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f544d9ea700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 0x7f5420052830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.494+0000 7f544d9ea700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 0x7f5420052830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f543801a000 tx=0x7f5438019000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.498+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5440040110 con 0x7f54480670f0 2020-07-16T20:30:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.648+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f54480a5bd0 con 0x7f54480670f0 2020-07-16T20:30:59.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.649+0000 7f5435ffb700 1 -- 172.21.15.157:0/4021086338 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5440043730 con 0x7f54480670f0 2020-07-16T20:30:59.652 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:30:59.658 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 msgr2=0x7f5420052830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 0x7f5420052830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f543801a000 tx=0x7f5438019000).stop 2020-07-16T20:30:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54480670f0 msgr2=0x7f54480aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54480670f0 0x7f54480aaa90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f54400032b0 tx=0x7f54400090f0).stop 2020-07-16T20:30:59.660 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 shutdown_connections 2020-07-16T20:30:59.661 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5420050370 0x7f5420052830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.661 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54480670f0 0x7f54480aaa90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.662 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 --2- 172.21.15.157:0/4021086338 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5448132f70 0x7f54481393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 >> 172.21.15.157:0/4021086338 conn(0x7f5448061820 msgr2=0x7f544805bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:59.665 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 shutdown_connections 2020-07-16T20:30:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.650+0000 7f544fc4e700 1 -- 172.21.15.157:0/4021086338 wait complete. 2020-07-16T20:30:59.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2020-07-16T20:30:59.670 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-07-16T20:30:59.783 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.778+0000 7f7cddb9a700 1 Processor -- start 2020-07-16T20:30:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 -- start start 2020-07-16T20:30:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7cd80ac240 0x7f7cd8135900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7cd8135df0 0x7f7cd8132860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.787 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd80ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.787 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd8136280 con 0x7f7cd8135df0 2020-07-16T20:30:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd80a4130 con 0x7f7cd80ac240 2020-07-16T20:30:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cddb9a700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80a6ce0 con 0x7f7cd8132d50 2020-07-16T20:30:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cd77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7cd80ac240 0x7f7cd8135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cd77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7cd80ac240 0x7f7cd8135900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34040/0 (socket says 172.21.15.157:34040) 2020-07-16T20:30:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.779+0000 7f7cd77fe700 1 -- 172.21.15.157:0/3664541935 learned_addr learned my addr 172.21.15.157:0/3664541935 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:30:59.793 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd7fff700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd80ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.794 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 -- 172.21.15.157:0/3664541935 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 msgr2=0x7f7cd80ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd80ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 -- 172.21.15.157:0/3664541935 >> v2:172.21.15.41:3300/0 conn(0x7f7cd8135df0 msgr2=0x7f7cd8132860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd6ffd700 1 --2- 172.21.15.157:0/3664541935 >> v2:172.21.15.41:3300/0 conn(0x7f7cd8135df0 0x7f7cd8132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/3664541935 >> v2:172.21.15.41:3300/0 conn(0x7f7cd8135df0 0x7f7cd8132860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 -- 172.21.15.157:0/3664541935 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80a3d00 con 0x7f7cd80ac240 2020-07-16T20:30:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cd80ac240 0x7f7cd8135900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7cc8002f30 tx=0x7f7cc8006e90).ready entity=mon.1 client_cookie=e5934d00bcff4144 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd67fc700 1 -- 172.21.15.157:0/3664541935 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc8009920 con 0x7f7cd80ac240 2020-07-16T20:30:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd67fc700 1 -- 172.21.15.157:0/3664541935 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8009a80 con 0x7f7cd80ac240 2020-07-16T20:30:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cd67fc700 1 -- 172.21.15.157:0/3664541935 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc8009de0 con 0x7f7cd80ac240 2020-07-16T20:30:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 -- 172.21.15.157:0/3664541935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cd80ac240 msgr2=0x7f7cd8135900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cd80ac240 0x7f7cd8135900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7cc8002f30 tx=0x7f7cc8006e90).stop 2020-07-16T20:30:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 -- 172.21.15.157:0/3664541935 shutdown_connections 2020-07-16T20:30:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd80ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/3664541935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cd80ac240 0x7f7cd8135900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/3664541935 >> v2:172.21.15.41:3300/0 conn(0x7f7cd8135df0 0x7f7cd8132860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 -- 172.21.15.157:0/3664541935 >> 172.21.15.157:0/3664541935 conn(0x7f7cd8061820 msgr2=0x7f7cd809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 -- 172.21.15.157:0/3664541935 shutdown_connections 2020-07-16T20:30:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.780+0000 7f7cddb9a700 1 -- 172.21.15.157:0/3664541935 wait complete. 2020-07-16T20:30:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 Processor -- start 2020-07-16T20:30:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 -- start start 2020-07-16T20:30:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd8062600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd8132ad0 con 0x7f7cd8131c10 2020-07-16T20:30:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd80a1430 con 0x7f7cd8135df0 2020-07-16T20:30:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cddb9a700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8131060 con 0x7f7cd8132d50 2020-07-16T20:30:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cd6ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7cd8135df0 0x7f7cd8131500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36732/0 (socket says 172.21.15.157:36732) 2020-07-16T20:30:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cd6ffd700 1 -- 172.21.15.157:0/2488516252 learned_addr learned my addr 172.21.15.157:0/2488516252 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:30:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd8062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357187669 0 0) 0x7f7cd80a1430 con 0x7f7cd8135df0 2020-07-16T20:30:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.782+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb0003240 con 0x7f7cd8135df0 2020-07-16T20:30:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963085258 0 0) 0x7f7cd8132ad0 con 0x7f7cd8131c10 2020-07-16T20:30:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd80a1430 con 0x7f7cd8131c10 2020-07-16T20:30:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2971865699 0 0) 0x7f7cb0003240 con 0x7f7cd8135df0 2020-07-16T20:30:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cd8132ad0 con 0x7f7cd8135df0 2020-07-16T20:30:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f7ccc001080 con 0x7f7cd8135df0 2020-07-16T20:30:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 msgr2=0x7f7cd8062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd8062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 >> v1:172.21.15.157:6789/0 conn(0x7f7cd8135df0 legacy=0x7f7cd8131500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.814 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 >> v1:172.21.15.41:6789/0 conn(0x7f7cd8131c10 legacy=0x7f7cd812ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cb0003970 0x7f7cb0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7cb00044e0 0x7f7cb0004940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cb0004e30 0x7f7cb000b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8131060 con 0x7f7cb00044e0 2020-07-16T20:30:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb000bc20 con 0x7f7cb0004e30 2020-07-16T20:30:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb000bd60 con 0x7f7cb0003970 2020-07-16T20:30:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cd8132d50 0x7f7cd8062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cb0004e30 0x7f7cb000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd6ffd700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7cb00044e0 0x7f7cb0004940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cb0003970 0x7f7cb0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 -- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cb0003970 msgr2=0x7f7cb0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f7cb0003970 0x7f7cb0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 -- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7cb00044e0 msgr2=0x7f7cb0004940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7cb00044e0 0x7f7cb0004940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8133570 con 0x7f7cb0004e30 2020-07-16T20:30:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd80a0b30 con 0x7f7cb0004e30 2020-07-16T20:30:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd6ffd700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7cb00044e0 0x7f7cb0004940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd812b550 con 0x7f7cb0004e30 2020-07-16T20:30:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cd7fff700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cb0004e30 0x7f7cb000b730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7cd00032b0 tx=0x7f7cd0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd0007910 con 0x7f7cb0004e30 2020-07-16T20:30:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd0007a70 con 0x7f7cb0004e30 2020-07-16T20:30:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.783+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd0007dd0 con 0x7f7cb0004e30 2020-07-16T20:30:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.784+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8057490 con 0x7f7cb0004e30 2020-07-16T20:30:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.784+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7cd001b460 con 0x7f7cb0004e30 2020-07-16T20:30:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.785+0000 7f7cb77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7cb0058a20 0x7f7cb005aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.785+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7cd0068180 con 0x7f7cb0004e30 2020-07-16T20:30:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.785+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7cb0058a20 0x7f7cb005aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.785+0000 7f7cd77fe700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7cb0058a20 0x7f7cb005aee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7cc8016000 tx=0x7f7cc8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.788+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f7cd0040830 con 0x7f7cb0004e30 2020-07-16T20:30:59.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.935+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7cd8043fd0 con 0x7f7cb0004e30 2020-07-16T20:30:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.936+0000 7f7cb77fe700 1 -- 172.21.15.157:0/2488516252 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cd0043e50 con 0x7f7cb0004e30 2020-07-16T20:30:59.939 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:30:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7cb0058a20 msgr2=0x7f7cb005aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7cb0058a20 0x7f7cb005aee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7cc8016000 tx=0x7f7cc8015000).stop 2020-07-16T20:30:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cb0004e30 msgr2=0x7f7cb000b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 --2- 172.21.15.157:0/2488516252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7cb0004e30 0x7f7cb000b730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7cd00032b0 tx=0x7f7cd0008040).stop 2020-07-16T20:30:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cd7fff700 1 -- 172.21.15.157:0/2488516252 reap_dead start 2020-07-16T20:30:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cd7fff700 1 -- 172.21.15.157:0/2488516252 reap_dead start 2020-07-16T20:30:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 shutdown_connections 2020-07-16T20:30:59.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 >> 172.21.15.157:0/2488516252 conn(0x7f7cd8061820 msgr2=0x7f7cd805bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 shutdown_connections 2020-07-16T20:30:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:30:59.937+0000 7f7cddb9a700 1 -- 172.21.15.157:0/2488516252 wait complete. 2020-07-16T20:30:59.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2020-07-16T20:30:59.950 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-07-16T20:31:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 Processor -- start 2020-07-16T20:31:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 -- start start 2020-07-16T20:31:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5ea40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea40a5450 con 0x7f5ea40a7fb0 2020-07-16T20:31:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea40a7880 con 0x7f5ea40a8460 2020-07-16T20:31:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.056+0000 7f5ea8c29700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40ac5a0 con 0x7f5ea40a48e0 2020-07-16T20:31:00.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea2d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5ea40a8460 0x7f5ea40abe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36744/0 (socket says 172.21.15.157:36744) 2020-07-16T20:31:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea2d9d700 1 -- 172.21.15.157:0/3775420351 learned_addr learned my addr 172.21.15.157:0/3775420351 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5ea40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623436216 0 0) 0x7f5ea40a7880 con 0x7f5ea40a8460 2020-07-16T20:31:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e88003240 con 0x7f5ea40a8460 2020-07-16T20:31:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518206907 0 0) 0x7f5ea40a5450 con 0x7f5ea40a7fb0 2020-07-16T20:31:00.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea40a7880 con 0x7f5ea40a7fb0 2020-07-16T20:31:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 730634802 0 0) 0x7f5e88003240 con 0x7f5ea40a8460 2020-07-16T20:31:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 msgr2=0x7f5ea40a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5ea40a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 >> v1:172.21.15.41:6789/0 conn(0x7f5ea40a7fb0 legacy=0x7f5ea40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40a56b0 con 0x7f5ea40a8460 2020-07-16T20:31:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f5e9c001a50 con 0x7f5ea40a8460 2020-07-16T20:31:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 >> v1:172.21.15.157:6789/0 conn(0x7f5ea40a8460 legacy=0x7f5ea40abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e880038c0 0x7f5e88003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5e880044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5e880049d0 0x7f5e88004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40ac5a0 con 0x7f5e880049d0 2020-07-16T20:31:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88005340 con 0x7f5e880038c0 2020-07-16T20:31:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8800b730 con 0x7f5ea40a48e0 2020-07-16T20:31:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e880038c0 0x7f5e88003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea2d9d700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5e880049d0 0x7f5e88004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea1d9b700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5e880044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 -- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 msgr2=0x7f5e880044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a48e0 0x7f5e880044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 -- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5e880049d0 msgr2=0x7f5e88004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5e880049d0 0x7f5e88004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea259c700 1 -- 172.21.15.157:0/3775420351 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88003240 con 0x7f5e880038c0 2020-07-16T20:31:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.057+0000 7f5ea2d9d700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5e880049d0 0x7f5e88004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e880038c0 0x7f5e88003ce0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5e9400c000 tx=0x7f5e94008040).ready entity=mon.1 client_cookie=8a940d21d18649df server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e9400e970 con 0x7f5e880038c0 2020-07-16T20:31:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400ead0 con 0x7f5e880038c0 2020-07-16T20:31:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea159a700 1 -- 172.21.15.157:0/3775420351 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e9400ee30 con 0x7f5e880038c0 2020-07-16T20:31:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3775420351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e880038c0 msgr2=0x7f5e88003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3775420351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e880038c0 0x7f5e88003ce0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5e9400c000 tx=0x7f5e94008040).stop 2020-07-16T20:31:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea2d9d700 1 -- 172.21.15.157:0/3775420351 reap_dead start 2020-07-16T20:31:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3775420351 shutdown_connections 2020-07-16T20:31:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3775420351 >> 172.21.15.157:0/3775420351 conn(0x7f5ea4061820 msgr2=0x7f5ea409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3775420351 shutdown_connections 2020-07-16T20:31:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.058+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3775420351 wait complete. 2020-07-16T20:31:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.059+0000 7f5ea8c29700 1 Processor -- start 2020-07-16T20:31:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.059+0000 7f5ea8c29700 1 -- start start 2020-07-16T20:31:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a6350 0x7f5ea4147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ea4067470 0x7f5ea4147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ea4067930 0x7f5ea414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea4067e60 con 0x7f5ea4067930 2020-07-16T20:31:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea4068100 con 0x7f5ea4067470 2020-07-16T20:31:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4146f70 con 0x7f5ea40a6350 2020-07-16T20:31:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ea4067470 0x7f5ea4147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ea4067470 0x7f5ea4147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34068/0 (socket says 172.21.15.157:34068) 2020-07-16T20:31:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 -- 172.21.15.157:0/3161577990 learned_addr learned my addr 172.21.15.157:0/3161577990 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a6350 0x7f5ea4147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea2d9d700 1 --2- 172.21.15.157:0/3161577990 >> v2:172.21.15.41:3300/0 conn(0x7f5ea4067930 0x7f5ea414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 -- 172.21.15.157:0/3161577990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a6350 msgr2=0x7f5ea4147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a6350 0x7f5ea4147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 -- 172.21.15.157:0/3161577990 >> v2:172.21.15.41:3300/0 conn(0x7f5ea4067930 msgr2=0x7f5ea414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 --2- 172.21.15.157:0/3161577990 >> v2:172.21.15.41:3300/0 conn(0x7f5ea4067930 0x7f5ea414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 -- 172.21.15.157:0/3161577990 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40a6730 con 0x7f5ea4067470 2020-07-16T20:31:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea1d9b700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ea4067470 0x7f5ea4147900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5e9800b000 tx=0x7f5e98009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e98001710 con 0x7f5ea4067470 2020-07-16T20:31:00.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e98001870 con 0x7f5ea4067470 2020-07-16T20:31:00.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea40a2540 con 0x7f5ea4067470 2020-07-16T20:31:00.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e98001bd0 con 0x7f5ea4067470 2020-07-16T20:31:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.060+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea414ac70 con 0x7f5ea4067470 2020-07-16T20:31:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.061+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea4057490 con 0x7f5ea4067470 2020-07-16T20:31:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.062+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5e9801b030 con 0x7f5ea4067470 2020-07-16T20:31:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.062+0000 7f5e927fc700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 0x7f5e780523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.062+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5e98067d40 con 0x7f5ea4067470 2020-07-16T20:31:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.062+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 0x7f5e780523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.062+0000 7f5ea259c700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 0x7f5e780523b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5e94008000 tx=0x7f5e9401a000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.065+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5e98040450 con 0x7f5ea4067470 2020-07-16T20:31:00.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.216+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ea41470e0 con 0x7f5ea4067470 2020-07-16T20:31:00.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.216+0000 7f5e927fc700 1 -- 172.21.15.157:0/3161577990 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e98043a70 con 0x7f5ea4067470 2020-07-16T20:31:00.219 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:31:00.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 msgr2=0x7f5e780523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 0x7f5e780523b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5e94008000 tx=0x7f5e9401a000).stop 2020-07-16T20:31:00.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ea4067470 msgr2=0x7f5ea4147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ea4067470 0x7f5ea4147900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5e9800b000 tx=0x7f5e98009040).stop 2020-07-16T20:31:00.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 shutdown_connections 2020-07-16T20:31:00.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5e7804fef0 0x7f5e780523b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ea40a6350 0x7f5ea4147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.223 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> v2:172.21.15.41:3300/0 conn(0x7f5ea4067930 0x7f5ea414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 --2- 172.21.15.157:0/3161577990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ea4067470 0x7f5ea4147900 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 >> 172.21.15.157:0/3161577990 conn(0x7f5ea4061820 msgr2=0x7f5ea405bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 shutdown_connections 2020-07-16T20:31:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.217+0000 7f5ea8c29700 1 -- 172.21.15.157:0/3161577990 wait complete. 2020-07-16T20:31:00.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2020-07-16T20:31:00.231 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-07-16T20:31:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 Processor -- start 2020-07-16T20:31:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 -- start start 2020-07-16T20:31:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a48e0 0x7f5ad00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ad00a7fb0 0x7f5ad00a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ad00ab780 0x7f5ad00abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00a5450 con 0x7f5ad00a48e0 2020-07-16T20:31:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00a7880 con 0x7f5ad00ab780 2020-07-16T20:31:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5ad5921700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00a8930 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.339+0000 7f5acf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ad00ab780 0x7f5ad00abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5ad00ab780 0x7f5ad00abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34078/0 (socket says 172.21.15.157:34078) 2020-07-16T20:31:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 -- 172.21.15.157:0/1909321650 learned_addr learned my addr 172.21.15.157:0/1909321650 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5aceffd700 1 --2- 172.21.15.157:0/1909321650 >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a48e0 0x7f5ad00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ace7fc700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ad00a7fb0 0x7f5ad00a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 -- 172.21.15.157:0/1909321650 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ad00a7fb0 msgr2=0x7f5ad00a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ad00a7fb0 0x7f5ad00a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 -- 172.21.15.157:0/1909321650 >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a48e0 msgr2=0x7f5ad00a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 --2- 172.21.15.157:0/1909321650 >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a48e0 0x7f5ad00a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 -- 172.21.15.157:0/1909321650 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00a56b0 con 0x7f5ad00ab780 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acf7fe700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ad00ab780 0x7f5ad00abbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5ac0002f30 tx=0x7f5ac0006e90).ready entity=mon.1 client_cookie=37e4f56a51c77bd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acdffb700 1 -- 172.21.15.157:0/1909321650 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac0009920 con 0x7f5ad00ab780 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acdffb700 1 -- 172.21.15.157:0/1909321650 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0009a80 con 0x7f5ad00ab780 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5acdffb700 1 -- 172.21.15.157:0/1909321650 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac0009de0 con 0x7f5ad00ab780 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 -- 172.21.15.157:0/1909321650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ad00ab780 msgr2=0x7f5ad00abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ad00ab780 0x7f5ad00abbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5ac0002f30 tx=0x7f5ac0006e90).stop 2020-07-16T20:31:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 -- 172.21.15.157:0/1909321650 shutdown_connections 2020-07-16T20:31:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ad00ab780 0x7f5ad00abbf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 --2- 172.21.15.157:0/1909321650 >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a48e0 0x7f5ad00a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 --2- 172.21.15.157:0/1909321650 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5ad00a7fb0 0x7f5ad00a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 -- 172.21.15.157:0/1909321650 >> 172.21.15.157:0/1909321650 conn(0x7f5ad0061820 msgr2=0x7f5ad009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 -- 172.21.15.157:0/1909321650 shutdown_connections 2020-07-16T20:31:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.340+0000 7f5ad5921700 1 -- 172.21.15.157:0/1909321650 wait complete. 2020-07-16T20:31:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 Processor -- start 2020-07-16T20:31:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 -- start start 2020-07-16T20:31:00.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a7fb0 0x7f5ad0067ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad01352e0 con 0x7f5ad014c5b0 2020-07-16T20:31:00.352 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad0135580 con 0x7f5ad00a48e0 2020-07-16T20:31:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ad5921700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00a68a0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5aceffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5ad00a48e0 0x7f5ad00a6190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36768/0 (socket says 172.21.15.157:36768) 2020-07-16T20:31:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5aceffd700 1 -- 172.21.15.157:0/2599623278 learned_addr learned my addr 172.21.15.157:0/2599623278 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.342+0000 7f5ace7fc700 1 --2- 172.21.15.157:0/2599623278 >> v2:172.21.15.41:3300/0 conn(0x7f5ad00a7fb0 0x7f5ad0067ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643258066 0 0) 0x7f5ad0135580 con 0x7f5ad00a48e0 2020-07-16T20:31:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aac003240 con 0x7f5ad00a48e0 2020-07-16T20:31:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ace7fc700 1 -- 172.21.15.157:0/2599623278 >> v1:172.21.15.157:6789/0 conn(0x7f5ad00a48e0 legacy=0x7f5ad00a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249240624 0 0) 0x7f5ad01352e0 con 0x7f5ad014c5b0 2020-07-16T20:31:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ace7fc700 1 -- 172.21.15.157:0/2599623278 >> v1:172.21.15.41:6789/0 conn(0x7f5ad014c5b0 legacy=0x7f5ad014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ace7fc700 1 -- 172.21.15.157:0/2599623278 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0135820 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ace7fc700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad00a7fb0 0x7f5ad0067ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5ac80032b0 tx=0x7f5ab8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac8001810 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800f690 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad00a6fd0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab800f9f0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.343+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0129bc0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.344+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad01359b0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.344+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5ab800fba0 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.345+0000 7f5ac6ffd700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 0x7f5aac052750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.345+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5ab8067530 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.345+0000 7f5aceffd700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 0x7f5aac052750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.345+0000 7f5aceffd700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 0x7f5aac052750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5ac8006e80 tx=0x7f5ac8001b10).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.349+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5ab803fc40 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.495+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ad0057490 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.498 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.496+0000 7f5ac6ffd700 1 -- 172.21.15.157:0/2599623278 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ab8043260 con 0x7f5ad00a7fb0 2020-07-16T20:31:00.498 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:31:00.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 msgr2=0x7f5aac052750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 0x7f5aac052750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5ac8006e80 tx=0x7f5ac8001b10).stop 2020-07-16T20:31:00.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad00a7fb0 msgr2=0x7f5ad0067ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.499 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad00a7fb0 0x7f5ad0067ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5ac80032b0 tx=0x7f5ab8008040).stop 2020-07-16T20:31:00.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 shutdown_connections 2020-07-16T20:31:00.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5aac050290 0x7f5aac052750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 --2- 172.21.15.157:0/2599623278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad00a7fb0 0x7f5ad0067ac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 >> 172.21.15.157:0/2599623278 conn(0x7f5ad0061820 msgr2=0x7f5ad012d270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.500 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 shutdown_connections 2020-07-16T20:31:00.501 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.497+0000 7f5ad5921700 1 -- 172.21.15.157:0/2599623278 wait complete. 2020-07-16T20:31:00.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2020-07-16T20:31:00.509 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-07-16T20:31:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 Processor -- start 2020-07-16T20:31:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 -- start start 2020-07-16T20:31:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 0x7f81c80a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c8137a40 0x7f81c8137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c813aee0 0x7f81c813b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80a5c70 con 0x7f81c80a24b0 2020-07-16T20:31:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c81372f0 con 0x7f81c8137a40 2020-07-16T20:31:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.615+0000 7f81ce16d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80a68a0 con 0x7f81c813aee0 2020-07-16T20:31:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c8137a40 0x7f81c8137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c8137a40 0x7f81c8137eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34092/0 (socket says 172.21.15.157:34092) 2020-07-16T20:31:00.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 -- 172.21.15.157:0/2342618689 learned_addr learned my addr 172.21.15.157:0/2342618689 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:00.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c77fe700 1 --2- 172.21.15.157:0/2342618689 >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 0x7f81c80a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c7fff700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c813aee0 0x7f81c813b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 -- 172.21.15.157:0/2342618689 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c813aee0 msgr2=0x7f81c813b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c813aee0 0x7f81c813b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 -- 172.21.15.157:0/2342618689 >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 msgr2=0x7f81c80a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/2342618689 >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 0x7f81c80a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 -- 172.21.15.157:0/2342618689 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c813aa40 con 0x7f81c8137a40 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c77fe700 1 --2- 172.21.15.157:0/2342618689 >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 0x7f81c80a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c8137a40 0x7f81c8137eb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f81bc002f30 tx=0x7f81bc006e90).ready entity=mon.1 client_cookie=a97c7179ac0cb4a9 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c67fc700 1 -- 172.21.15.157:0/2342618689 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81bc009920 con 0x7f81c8137a40 2020-07-16T20:31:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c67fc700 1 -- 172.21.15.157:0/2342618689 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc009a80 con 0x7f81c8137a40 2020-07-16T20:31:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81c67fc700 1 -- 172.21.15.157:0/2342618689 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81bc009de0 con 0x7f81c8137a40 2020-07-16T20:31:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 -- 172.21.15.157:0/2342618689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c8137a40 msgr2=0x7f81c8137eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c8137a40 0x7f81c8137eb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f81bc002f30 tx=0x7f81bc006e90).stop 2020-07-16T20:31:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 -- 172.21.15.157:0/2342618689 shutdown_connections 2020-07-16T20:31:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c813aee0 0x7f81c813b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 --2- 172.21.15.157:0/2342618689 >> v2:172.21.15.41:3300/0 conn(0x7f81c80a24b0 0x7f81c80a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 --2- 172.21.15.157:0/2342618689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c8137a40 0x7f81c8137eb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 -- 172.21.15.157:0/2342618689 >> 172.21.15.157:0/2342618689 conn(0x7f81c8061820 msgr2=0x7f81c809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 -- 172.21.15.157:0/2342618689 shutdown_connections 2020-07-16T20:31:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.616+0000 7f81ce16d700 1 -- 172.21.15.157:0/2342618689 wait complete. 2020-07-16T20:31:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 Processor -- start 2020-07-16T20:31:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 -- start start 2020-07-16T20:31:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c80a24b0 0x7f81c8139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f81c813aee0 0x7f81c8062f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c80a1240 0x7f81c8147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c8146e50 con 0x7f81c813aee0 2020-07-16T20:31:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c8064df0 con 0x7f81c80a24b0 2020-07-16T20:31:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.618+0000 7f81ce16d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8065090 con 0x7f81c80a1240 2020-07-16T20:31:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c80a24b0 0x7f81c8139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f81c80a24b0 0x7f81c8139d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34094/0 (socket says 172.21.15.157:34094) 2020-07-16T20:31:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 -- 172.21.15.157:0/1607003705 learned_addr learned my addr 172.21.15.157:0/1607003705 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c7fff700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c80a1240 0x7f81c8147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/1607003705 >> v2:172.21.15.41:3300/0 conn(0x7f81c813aee0 0x7f81c8062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 -- 172.21.15.157:0/1607003705 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c80a1240 msgr2=0x7f81c8147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c80a1240 0x7f81c8147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 -- 172.21.15.157:0/1607003705 >> v2:172.21.15.41:3300/0 conn(0x7f81c813aee0 msgr2=0x7f81c8062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 --2- 172.21.15.157:0/1607003705 >> v2:172.21.15.41:3300/0 conn(0x7f81c813aee0 0x7f81c8062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 -- 172.21.15.157:0/1607003705 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8064b20 con 0x7f81c80a24b0 2020-07-16T20:31:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81c77fe700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c80a24b0 0x7f81c8139d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f81b8007000 tx=0x7f81b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81b8010580 con 0x7f81c80a24b0 2020-07-16T20:31:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b80106e0 con 0x7f81c80a24b0 2020-07-16T20:31:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80626c0 con 0x7f81c80a24b0 2020-07-16T20:31:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81b8010a40 con 0x7f81c80a24b0 2020-07-16T20:31:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.619+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c80635f0 con 0x7f81c80a24b0 2020-07-16T20:31:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.620+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c80653a0 con 0x7f81c80a24b0 2020-07-16T20:31:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.620+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f81b8010cb0 con 0x7f81c80a24b0 2020-07-16T20:31:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.621+0000 7f81a77fe700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 0x7f81a0052460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.621+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f81b8067d80 con 0x7f81c80a24b0 2020-07-16T20:31:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.621+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 0x7f81a0052460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.621+0000 7f81c6ffd700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 0x7f81a0052460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f81bc01c000 tx=0x7f81bc015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.624+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f81b8040490 con 0x7f81c80a24b0 2020-07-16T20:31:00.775 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.774+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f81c8062ca0 con 0x7f81c80a24b0 2020-07-16T20:31:00.776 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.774+0000 7f81a77fe700 1 -- 172.21.15.157:0/1607003705 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81c8062ca0 con 0x7f81c80a24b0 2020-07-16T20:31:00.776 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2020-07-16T20:31:00.777 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.775+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 msgr2=0x7f81a0052460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.777 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.775+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 0x7f81a0052460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f81bc01c000 tx=0x7f81bc015000).stop 2020-07-16T20:31:00.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c80a24b0 msgr2=0x7f81c8139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c80a24b0 0x7f81c8139d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f81b8007000 tx=0x7f81b8008040).stop 2020-07-16T20:31:00.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 shutdown_connections 2020-07-16T20:31:00.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f81a004ffa0 0x7f81a0052460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.778 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f81c80a1240 0x7f81c8147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c80a24b0 0x7f81c8139d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 --2- 172.21.15.157:0/1607003705 >> v2:172.21.15.41:3300/0 conn(0x7f81c813aee0 0x7f81c8062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 >> 172.21.15.157:0/1607003705 conn(0x7f81c8061820 msgr2=0x7f81c80a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 shutdown_connections 2020-07-16T20:31:00.779 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.776+0000 7f81ce16d700 1 -- 172.21.15.157:0/1607003705 wait complete. 2020-07-16T20:31:00.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2020-07-16T20:31:00.788 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-07-16T20:31:00.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.893+0000 7fea27b86700 1 Processor -- start 2020-07-16T20:31:00.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.893+0000 7fea27b86700 1 -- start start 2020-07-16T20:31:00.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea27b86700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fea200a48e0 0x7fea200a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea27b86700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea200a8420 0x7fea200abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea27b86700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200a5450 con 0x7fea200a7fb0 2020-07-16T20:31:00.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea27b86700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200a7880 con 0x7fea200a48e0 2020-07-16T20:31:00.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea27b86700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200a56b0 con 0x7fea200a8420 2020-07-16T20:31:00.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea26123700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea200a8420 0x7fea200abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea25121700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fea200a7fb0 0x7fea200ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36790/0 (socket says 172.21.15.157:36790) 2020-07-16T20:31:00.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea25121700 1 -- 172.21.15.157:0/779618595 learned_addr learned my addr 172.21.15.157:0/779618595 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:00.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.894+0000 7fea25922700 1 --2- 172.21.15.157:0/779618595 >> v2:172.21.15.41:3300/0 conn(0x7fea200a48e0 0x7fea200a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea26123700 1 -- 172.21.15.157:0/779618595 >> v2:172.21.15.41:3300/0 conn(0x7fea200a48e0 msgr2=0x7fea200a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:00.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea26123700 1 --2- 172.21.15.157:0/779618595 >> v2:172.21.15.41:3300/0 conn(0x7fea200a48e0 0x7fea200a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea26123700 1 -- 172.21.15.157:0/779618595 >> v1:172.21.15.157:6789/0 conn(0x7fea200a7fb0 legacy=0x7fea200ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea26123700 1 -- 172.21.15.157:0/779618595 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200a5950 con 0x7fea200a8420 2020-07-16T20:31:00.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea26123700 1 --2- 172.21.15.157:0/779618595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea200a8420 0x7fea200abe90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fea180032b0 tx=0x7fea180091d0).ready entity=mon.1 client_cookie=b9e4050b6a8123b1 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea24920700 1 -- 172.21.15.157:0/779618595 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1800ba50 con 0x7fea200a8420 2020-07-16T20:31:00.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea24920700 1 -- 172.21.15.157:0/779618595 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800bbb0 con 0x7fea200a8420 2020-07-16T20:31:00.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea24920700 1 -- 172.21.15.157:0/779618595 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1800bd20 con 0x7fea200a8420 2020-07-16T20:31:00.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 -- 172.21.15.157:0/779618595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea200a8420 msgr2=0x7fea200abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.911 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 --2- 172.21.15.157:0/779618595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea200a8420 0x7fea200abe90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fea180032b0 tx=0x7fea180091d0).stop 2020-07-16T20:31:00.911 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 -- 172.21.15.157:0/779618595 shutdown_connections 2020-07-16T20:31:00.911 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 --2- 172.21.15.157:0/779618595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea200a8420 0x7fea200abe90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.912 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 --2- 172.21.15.157:0/779618595 >> v2:172.21.15.41:3300/0 conn(0x7fea200a48e0 0x7fea200a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.912 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 -- 172.21.15.157:0/779618595 >> 172.21.15.157:0/779618595 conn(0x7fea20061820 msgr2=0x7fea2009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:00.912 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 -- 172.21.15.157:0/779618595 shutdown_connections 2020-07-16T20:31:00.913 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.895+0000 7fea27b86700 1 -- 172.21.15.157:0/779618595 wait complete. 2020-07-16T20:31:00.913 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.896+0000 7fea27b86700 1 Processor -- start 2020-07-16T20:31:00.913 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.896+0000 7fea27b86700 1 -- start start 2020-07-16T20:31:00.914 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea27b86700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fea200672e0 0x7fea20064c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.914 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea27b86700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200a21e0 con 0x7fea200a48e0 2020-07-16T20:31:00.914 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea27b86700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200a2480 con 0x7fea200a7fb0 2020-07-16T20:31:00.915 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea27b86700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2012f230 con 0x7fea200672e0 2020-07-16T20:31:00.915 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea25121700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fea200a7fb0 0x7fea20066bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36796/0 (socket says 172.21.15.157:36796) 2020-07-16T20:31:00.915 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea25121700 1 -- 172.21.15.157:0/184124415 learned_addr learned my addr 172.21.15.157:0/184124415 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:00.916 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fea200672e0 0x7fea20064c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.916 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279619726 0 0) 0x7fea200a2480 con 0x7fea200a7fb0 2020-07-16T20:31:00.916 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f8003240 con 0x7fea200a7fb0 2020-07-16T20:31:00.917 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863196654 0 0) 0x7fea200a21e0 con 0x7fea200a48e0 2020-07-16T20:31:00.917 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea200a2480 con 0x7fea200a48e0 2020-07-16T20:31:00.917 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 68044666 0 0) 0x7fe9f8003240 con 0x7fea200a7fb0 2020-07-16T20:31:00.918 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea200a21e0 con 0x7fea200a7fb0 2020-07-16T20:31:00.918 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fea100017d0 con 0x7fea200a7fb0 2020-07-16T20:31:00.918 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.897+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fea200672e0 msgr2=0x7fea20064c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.919 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fea200672e0 0x7fea20064c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.919 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 >> v1:172.21.15.157:6789/0 conn(0x7fea200a7fb0 legacy=0x7fea20066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.919 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 >> v1:172.21.15.41:6789/0 conn(0x7fea200a48e0 legacy=0x7fea2012eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.920 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f80038d0 0x7fe9f8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.920 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe9f80044e0 0x7fe9f8004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.920 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f8004e10 0x7fe9f800b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2012f230 con 0x7fe9f80038d0 2020-07-16T20:31:00.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f800bc20 con 0x7fe9f8004e10 2020-07-16T20:31:00.921 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f800bd60 con 0x7fe9f80044e0 2020-07-16T20:31:00.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fea200672e0 0x7fea20064c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:00.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f8004e10 0x7fe9f800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.922 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea25922700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f80038d0 0x7fe9f8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea25121700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe9f80044e0 0x7fe9f8004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 -- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe9f80044e0 msgr2=0x7fe9f8004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.923 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fe9f80044e0 0x7fe9f8004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 -- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f80038d0 msgr2=0x7fe9f8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:00.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f80038d0 0x7fe9f8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:00.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2012f370 con 0x7fe9f8004e10 2020-07-16T20:31:00.924 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea20065290 con 0x7fe9f8004e10 2020-07-16T20:31:00.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea20064c70 con 0x7fe9f8004e10 2020-07-16T20:31:00.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea26123700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f8004e10 0x7fe9f800b730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fea1801c000 tx=0x7fea18016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18025070 con 0x7fe9f8004e10 2020-07-16T20:31:00.925 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180108f0 con 0x7fe9f8004e10 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.898+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18010c50 con 0x7fe9f8004e10 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.899+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea20057490 con 0x7fe9f8004e10 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.899+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fea1800f070 con 0x7fe9f8004e10 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.900+0000 7fea0dffb700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe9f8058920 0x7fe9f805ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.900+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fea180696b0 con 0x7fe9f8004e10 2020-07-16T20:31:00.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.900+0000 7fea25922700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe9f8058920 0x7fe9f805ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:00.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.900+0000 7fea25922700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe9f8058920 0x7fe9f805ade0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea1c00e000 tx=0x7fea1c008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:00.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:00.903+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fea18045920 con 0x7fe9f8004e10 2020-07-16T20:31:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.049+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea200a2c30 con 0x7fe9f8004e10 2020-07-16T20:31:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.050+0000 7fea0dffb700 1 -- 172.21.15.157:0/184124415 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea1801b020 con 0x7fe9f8004e10 2020-07-16T20:31:01.052 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:31:01.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe9f8058920 msgr2=0x7fe9f805ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe9f8058920 0x7fe9f805ade0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea1c00e000 tx=0x7fea1c008040).stop 2020-07-16T20:31:01.053 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f8004e10 msgr2=0x7fe9f800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 --2- 172.21.15.157:0/184124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9f8004e10 0x7fe9f800b730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fea1801c000 tx=0x7fea18016000).stop 2020-07-16T20:31:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea26123700 1 -- 172.21.15.157:0/184124415 reap_dead start 2020-07-16T20:31:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea26123700 1 -- 172.21.15.157:0/184124415 reap_dead start 2020-07-16T20:31:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 shutdown_connections 2020-07-16T20:31:01.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 >> 172.21.15.157:0/184124415 conn(0x7fea20061820 msgr2=0x7fea2009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 shutdown_connections 2020-07-16T20:31:01.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.051+0000 7fea27b86700 1 -- 172.21.15.157:0/184124415 wait complete. 2020-07-16T20:31:01.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2020-07-16T20:31:01.063 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-07-16T20:31:01.171 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.169+0000 7f28b11a4700 1 Processor -- start 2020-07-16T20:31:01.171 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.169+0000 7f28b11a4700 1 -- start start 2020-07-16T20:31:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28ac0a7fb0 0x7f28ac0a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f28ac0ab780 0x7f28ac0abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0a5450 con 0x7f28ac0a48e0 2020-07-16T20:31:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0a7880 con 0x7f28ac0a7fb0 2020-07-16T20:31:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28b11a4700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0a56b0 con 0x7f28ac0ab780 2020-07-16T20:31:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28ac0a7fb0 0x7f28ac0a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28ac0a7fb0 0x7f28ac0a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34124/0 (socket says 172.21.15.157:34124) 2020-07-16T20:31:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 -- 172.21.15.157:0/2230460747 learned_addr learned my addr 172.21.15.157:0/2230460747 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28ab59e700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f28ac0ab780 0x7f28ac0abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aad9d700 1 --2- 172.21.15.157:0/2230460747 >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 -- 172.21.15.157:0/2230460747 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f28ac0ab780 msgr2=0x7f28ac0abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f28ac0ab780 0x7f28ac0abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 -- 172.21.15.157:0/2230460747 >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 msgr2=0x7f28ac0a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 --2- 172.21.15.157:0/2230460747 >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac0a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.170+0000 7f28aa59c700 1 -- 172.21.15.157:0/2230460747 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0a5950 con 0x7f28ac0a7fb0 2020-07-16T20:31:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28aa59c700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac0a7fb0 0x7f28ac0a8420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f289c002f30 tx=0x7f289c006e90).ready entity=mon.1 client_cookie=c8fcec4c060a909f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28a9d9b700 1 -- 172.21.15.157:0/2230460747 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c009920 con 0x7f28ac0a7fb0 2020-07-16T20:31:01.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28a9d9b700 1 -- 172.21.15.157:0/2230460747 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c009a80 con 0x7f28ac0a7fb0 2020-07-16T20:31:01.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28a9d9b700 1 -- 172.21.15.157:0/2230460747 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c009de0 con 0x7f28ac0a7fb0 2020-07-16T20:31:01.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 -- 172.21.15.157:0/2230460747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac0a7fb0 msgr2=0x7f28ac0a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac0a7fb0 0x7f28ac0a8420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f289c002f30 tx=0x7f289c006e90).stop 2020-07-16T20:31:01.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 -- 172.21.15.157:0/2230460747 shutdown_connections 2020-07-16T20:31:01.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f28ac0ab780 0x7f28ac0abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 --2- 172.21.15.157:0/2230460747 >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac0a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 --2- 172.21.15.157:0/2230460747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac0a7fb0 0x7f28ac0a8420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 -- 172.21.15.157:0/2230460747 >> 172.21.15.157:0/2230460747 conn(0x7f28ac061820 msgr2=0x7f28ac09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 -- 172.21.15.157:0/2230460747 shutdown_connections 2020-07-16T20:31:01.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.171+0000 7f28b11a4700 1 -- 172.21.15.157:0/2230460747 wait complete. 2020-07-16T20:31:01.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.172+0000 7f28b11a4700 1 Processor -- start 2020-07-16T20:31:01.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.172+0000 7f28b11a4700 1 -- start start 2020-07-16T20:31:01.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28b11a4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac1383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28b11a4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac132950 con 0x7f28ac0ab780 2020-07-16T20:31:01.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28b11a4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac132040 con 0x7f28ac131ba0 2020-07-16T20:31:01.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28b11a4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac139be0 con 0x7f28ac0a48e0 2020-07-16T20:31:01.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28ab59e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f28ac131ba0 0x7f28ac128b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36818/0 (socket says 172.21.15.157:36818) 2020-07-16T20:31:01.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28ab59e700 1 -- 172.21.15.157:0/147426790 learned_addr learned my addr 172.21.15.157:0/147426790 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:01.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28aad9d700 1 --2- 172.21.15.157:0/147426790 >> v2:172.21.15.41:3300/0 conn(0x7f28ac0a48e0 0x7f28ac1383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411713005 0 0) 0x7f28ac132040 con 0x7f28ac131ba0 2020-07-16T20:31:01.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.173+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2888003240 con 0x7f28ac131ba0 2020-07-16T20:31:01.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28aad9d700 1 -- 172.21.15.157:0/147426790 >> v1:172.21.15.157:6789/0 conn(0x7f28ac131ba0 legacy=0x7f28ac128b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 310339080 0 0) 0x7f2888003240 con 0x7f28ac131ba0 2020-07-16T20:31:01.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28aad9d700 1 -- 172.21.15.157:0/147426790 >> v1:172.21.15.41:6789/0 conn(0x7f28ac0ab780 legacy=0x7f28ac137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28aad9d700 1 -- 172.21.15.157:0/147426790 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac13fab0 con 0x7f28ac0a48e0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28aad9d700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28ac0a48e0 0x7f28ac1383a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f28ac1305b0 tx=0x7f2894008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a4001620 con 0x7f28ac0a48e0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400c030 con 0x7f28ac0a48e0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0ab4d0 con 0x7f28ac0a48e0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289400e630 con 0x7f28ac0a48e0 2020-07-16T20:31:01.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.174+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac13a430 con 0x7f28ac0a48e0 2020-07-16T20:31:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.175+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac139fa0 con 0x7f28ac0a48e0 2020-07-16T20:31:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.175+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2894019070 con 0x7f28ac0a48e0 2020-07-16T20:31:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.175+0000 7f28a2ffd700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 0x7f28880527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.175+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2894067170 con 0x7f28ac0a48e0 2020-07-16T20:31:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.175+0000 7f28aa59c700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 0x7f28880527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.176+0000 7f28aa59c700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 0x7f28880527d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f289c002ef0 tx=0x7f289c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.179+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f289403f860 con 0x7f28ac0a48e0 2020-07-16T20:31:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.326+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f28ac057490 con 0x7f28ac0a48e0 2020-07-16T20:31:01.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.327+0000 7f28a2ffd700 1 -- 172.21.15.157:0/147426790 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2894042e80 con 0x7f28ac0a48e0 2020-07-16T20:31:01.329 INFO:teuthology.orchestra.run.smithi157.stdout:55834574856 2020-07-16T20:31:01.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 msgr2=0x7f28880527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 0x7f28880527d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f289c002ef0 tx=0x7f289c015000).stop 2020-07-16T20:31:01.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28ac0a48e0 msgr2=0x7f28ac1383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28ac0a48e0 0x7f28ac1383a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f28ac1305b0 tx=0x7f2894008040).stop 2020-07-16T20:31:01.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 shutdown_connections 2020-07-16T20:31:01.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2888050310 0x7f28880527d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 --2- 172.21.15.157:0/147426790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28ac0a48e0 0x7f28ac1383a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 >> 172.21.15.157:0/147426790 conn(0x7f28ac061820 msgr2=0x7f28ac140340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 shutdown_connections 2020-07-16T20:31:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.328+0000 7f28b11a4700 1 -- 172.21.15.157:0/147426790 wait complete. 2020-07-16T20:31:01.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2020-07-16T20:31:01.341 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-07-16T20:31:01.449 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.447+0000 7f807b7f9700 1 Processor -- start 2020-07-16T20:31:01.449 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 -- start start 2020-07-16T20:31:01.451 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f80740ac240 0x7f8074135900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.452 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8074132f70 0x7f8074140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.452 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80740a3d00 con 0x7f8074135df0 2020-07-16T20:31:01.452 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740a4130 con 0x7f8074132f70 2020-07-16T20:31:01.452 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f807b7f9700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80740a6ce0 con 0x7f80740ac240 2020-07-16T20:31:01.452 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f8079d96700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8074132f70 0x7f8074140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f8078d94700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8074135df0 0x7f8074132860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36824/0 (socket says 172.21.15.157:36824) 2020-07-16T20:31:01.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.448+0000 7f8078d94700 1 -- 172.21.15.157:0/656296249 learned_addr learned my addr 172.21.15.157:0/656296249 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:01.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8079d96700 1 -- 172.21.15.157:0/656296249 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f80740ac240 msgr2=0x7f8074135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:01.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8079d96700 1 --2- 172.21.15.157:0/656296249 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f80740ac240 0x7f8074135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:31:01.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8079d96700 1 -- 172.21.15.157:0/656296249 >> v1:172.21.15.157:6789/0 conn(0x7f8074135df0 legacy=0x7f8074132860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8063fff700 1 -- 172.21.15.157:0/656296249 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414820241 0 0) 0x7f80740a3d00 con 0x7f8074135df0 2020-07-16T20:31:01.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8079d96700 1 -- 172.21.15.157:0/656296249 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740a4320 con 0x7f8074132f70 2020-07-16T20:31:01.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8079d96700 1 --2- 172.21.15.157:0/656296249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8074132f70 0x7f8074140270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f806c0032b0 tx=0x7f806c0091d0).ready entity=mon.1 client_cookie=f59f5b868bea1676 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8063fff700 1 -- 172.21.15.157:0/656296249 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c00bc40 con 0x7f8074132f70 2020-07-16T20:31:01.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8063fff700 1 -- 172.21.15.157:0/656296249 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00bda0 con 0x7f8074132f70 2020-07-16T20:31:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f8063fff700 1 -- 172.21.15.157:0/656296249 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c010600 con 0x7f8074132f70 2020-07-16T20:31:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 -- 172.21.15.157:0/656296249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8074132f70 msgr2=0x7f8074140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 --2- 172.21.15.157:0/656296249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8074132f70 0x7f8074140270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f806c0032b0 tx=0x7f806c0091d0).stop 2020-07-16T20:31:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 -- 172.21.15.157:0/656296249 shutdown_connections 2020-07-16T20:31:01.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 --2- 172.21.15.157:0/656296249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8074132f70 0x7f8074140270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 --2- 172.21.15.157:0/656296249 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f80740ac240 0x7f8074135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-07-16T20:31:01.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 -- 172.21.15.157:0/656296249 >> 172.21.15.157:0/656296249 conn(0x7f8074061820 msgr2=0x7f807409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 -- 172.21.15.157:0/656296249 shutdown_connections 2020-07-16T20:31:01.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.449+0000 7f807b7f9700 1 -- 172.21.15.157:0/656296249 wait complete. 2020-07-16T20:31:01.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.450+0000 7f807b7f9700 1 Processor -- start 2020-07-16T20:31:01.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.450+0000 7f807b7f9700 1 -- start start 2020-07-16T20:31:01.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f807b7f9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80740a1250 0x7f80740a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f807b7f9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80740a17d0 con 0x7f8074135df0 2020-07-16T20:31:01.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f807b7f9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807409fea0 con 0x7f80740ac240 2020-07-16T20:31:01.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f807b7f9700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740a0140 con 0x7f80740a1250 2020-07-16T20:31:01.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80740a1250 0x7f80740a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079595700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f80740ac240 0x7f80741372f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36830/0 (socket says 172.21.15.157:36830) 2020-07-16T20:31:01.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079595700 1 -- 172.21.15.157:0/220250748 learned_addr learned my addr 172.21.15.157:0/220250748 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:01.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80740a1250 0x7f80740a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34146/0 (socket says 172.21.15.157:34146) 2020-07-16T20:31:01.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 -- 172.21.15.157:0/220250748 >> v1:172.21.15.157:6789/0 conn(0x7f80740ac240 legacy=0x7f80741372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 -- 172.21.15.157:0/220250748 >> v1:172.21.15.41:6789/0 conn(0x7f8074135df0 legacy=0x7f807412c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259121285 0 0) 0x7f807409fea0 con 0x7f80740ac240 2020-07-16T20:31:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 -- 172.21.15.157:0/220250748 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074132a90 con 0x7f80740a1250 2020-07-16T20:31:01.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.451+0000 7f8079d96700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80740a1250 0x7f80740a05e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f80741370f0 tx=0x7f806c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.452+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c01bc90 con 0x7f80740a1250 2020-07-16T20:31:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.452+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c01bdf0 con 0x7f80740a1250 2020-07-16T20:31:01.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.452+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807409f1f0 con 0x7f80740a1250 2020-07-16T20:31:01.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.452+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c019650 con 0x7f80740a1250 2020-07-16T20:31:01.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.452+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807412fcf0 con 0x7f80740a1250 2020-07-16T20:31:01.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80740a0310 con 0x7f80740a1250 2020-07-16T20:31:01.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f806c00e040 con 0x7f80740a1250 2020-07-16T20:31:01.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f80617fa700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 0x7f804c0523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f806c06a340 con 0x7f80740a1250 2020-07-16T20:31:01.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f8079595700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 0x7f804c0523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.453+0000 7f8079595700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 0x7f804c0523f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8064002190 tx=0x7f8064007940).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.456+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f806c046480 con 0x7f80740a1250 2020-07-16T20:31:01.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.602+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8074057490 con 0x7f80740a1250 2020-07-16T20:31:01.604 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.602+0000 7f80617fa700 1 -- 172.21.15.157:0/220250748 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f806c014090 con 0x7f80740a1250 2020-07-16T20:31:01.604 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2020-07-16T20:31:01.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 msgr2=0x7f804c0523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 0x7f804c0523f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8064002190 tx=0x7f8064007940).stop 2020-07-16T20:31:01.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80740a1250 msgr2=0x7f80740a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.606 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80740a1250 0x7f80740a05e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f80741370f0 tx=0x7f806c017000).stop 2020-07-16T20:31:01.606 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 shutdown_connections 2020-07-16T20:31:01.606 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f804c04ff30 0x7f804c0523f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 --2- 172.21.15.157:0/220250748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80740a1250 0x7f80740a05e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 >> 172.21.15.157:0/220250748 conn(0x7f8074061820 msgr2=0x7f80740ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 shutdown_connections 2020-07-16T20:31:01.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.603+0000 7f807b7f9700 1 -- 172.21.15.157:0/220250748 wait complete. 2020-07-16T20:31:01.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2020-07-16T20:31:01.616 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-07-16T20:31:01.617 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:31:01.724 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 Processor -- start 2020-07-16T20:31:01.725 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 -- start start 2020-07-16T20:31:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 0x7f58940a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58940a8460 0x7f58940abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940a5450 con 0x7f58940a7fb0 2020-07-16T20:31:01.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58940a7880 con 0x7f58940a8460 2020-07-16T20:31:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.723+0000 7f589c5d5700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940a56b0 con 0x7f58940a48e0 2020-07-16T20:31:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58940a8460 0x7f58940abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f5899b70700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f58940a7fb0 0x7f58940ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36838/0 (socket says 172.21.15.157:36838) 2020-07-16T20:31:01.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f5899b70700 1 -- 172.21.15.157:0/1600338213 learned_addr learned my addr 172.21.15.157:0/1600338213 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:01.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589a371700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 0x7f58940a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 -- 172.21.15.157:0/1600338213 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 msgr2=0x7f58940a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 0x7f58940a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 -- 172.21.15.157:0/1600338213 >> v1:172.21.15.157:6789/0 conn(0x7f58940a7fb0 legacy=0x7f58940ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 -- 172.21.15.157:0/1600338213 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940a5950 con 0x7f58940a8460 2020-07-16T20:31:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589936f700 1 -- 172.21.15.157:0/1600338213 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201334540 0 0) 0x7f58940a5450 con 0x7f58940a7fb0 2020-07-16T20:31:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589a371700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 0x7f58940a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589ab72700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58940a8460 0x7f58940abe90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f588c0032b0 tx=0x7f588c0091d0).ready entity=mon.1 client_cookie=494d1765a34305a0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589936f700 1 -- 172.21.15.157:0/1600338213 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c00ba50 con 0x7f58940a8460 2020-07-16T20:31:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589936f700 1 -- 172.21.15.157:0/1600338213 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00bbb0 con 0x7f58940a8460 2020-07-16T20:31:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589936f700 1 -- 172.21.15.157:0/1600338213 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c00bd20 con 0x7f58940a8460 2020-07-16T20:31:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 -- 172.21.15.157:0/1600338213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58940a8460 msgr2=0x7f58940abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58940a8460 0x7f58940abe90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f588c0032b0 tx=0x7f588c0091d0).stop 2020-07-16T20:31:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 -- 172.21.15.157:0/1600338213 shutdown_connections 2020-07-16T20:31:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58940a8460 0x7f58940abe90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 --2- 172.21.15.157:0/1600338213 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a48e0 0x7f58940a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 -- 172.21.15.157:0/1600338213 >> 172.21.15.157:0/1600338213 conn(0x7f5894061820 msgr2=0x7f589409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 -- 172.21.15.157:0/1600338213 shutdown_connections 2020-07-16T20:31:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.724+0000 7f589c5d5700 1 -- 172.21.15.157:0/1600338213 wait complete. 2020-07-16T20:31:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 Processor -- start 2020-07-16T20:31:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 -- start start 2020-07-16T20:31:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f58940679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940a62a0 con 0x7f5894130a00 2020-07-16T20:31:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940a6540 con 0x7f58940a48e0 2020-07-16T20:31:01.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589c5d5700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940a67e0 con 0x7f58940a7fb0 2020-07-16T20:31:01.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589a371700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f58940a48e0 0x7f5894066950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36844/0 (socket says 172.21.15.157:36844) 2020-07-16T20:31:01.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f589a371700 1 -- 172.21.15.157:0/3839856989 learned_addr learned my addr 172.21.15.157:0/3839856989 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270620597 0 0) 0x7f58940a6540 con 0x7f58940a48e0 2020-07-16T20:31:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003240 con 0x7f58940a48e0 2020-07-16T20:31:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.726+0000 7f5899b70700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f58940679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3048070656 0 0) 0x7f586c003240 con 0x7f58940a48e0 2020-07-16T20:31:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58940a6540 con 0x7f58940a48e0 2020-07-16T20:31:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f5888001080 con 0x7f58940a48e0 2020-07-16T20:31:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 msgr2=0x7f58940679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f58940679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 >> v1:172.21.15.157:6789/0 conn(0x7f58940a48e0 legacy=0x7f5894066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 >> v1:172.21.15.41:6789/0 conn(0x7f5894130a00 legacy=0x7f58941299e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f586c003800 0x7f586c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f586c0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 0x7f586c004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940a67e0 con 0x7f586c003800 2020-07-16T20:31:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0041f0 con 0x7f586c0049d0 2020-07-16T20:31:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c00b730 con 0x7f58940a7fb0 2020-07-16T20:31:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 0x7f586c004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589a371700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f586c003800 0x7f586c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f5899b70700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f586c0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 -- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 msgr2=0x7f586c0044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f58940a7fb0 0x7f586c0044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 -- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f586c003800 msgr2=0x7f586c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f586c003800 0x7f586c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940666b0 con 0x7f586c0049d0 2020-07-16T20:31:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894067060 con 0x7f586c0049d0 2020-07-16T20:31:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589ab72700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 0x7f586c004e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f588c003270 tx=0x7f588c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58941327e0 con 0x7f586c0049d0 2020-07-16T20:31:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c0108a0 con 0x7f586c0049d0 2020-07-16T20:31:01.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.727+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c010a00 con 0x7f586c0049d0 2020-07-16T20:31:01.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.728+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c010d60 con 0x7f586c0049d0 2020-07-16T20:31:01.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.728+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58940a4210 con 0x7f586c0049d0 2020-07-16T20:31:01.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.728+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f588c01e070 con 0x7f586c0049d0 2020-07-16T20:31:01.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.729+0000 7f58867fc700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f586c0582e0 0x7f586c05a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:01.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.729+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f588c068cb0 con 0x7f586c0049d0 2020-07-16T20:31:01.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.729+0000 7f589a371700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f586c0582e0 0x7f586c05a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.729+0000 7f589a371700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f586c0582e0 0x7f586c05a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f588800e000 tx=0x7f5888008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.732+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f588c041400 con 0x7f586c0049d0 2020-07-16T20:31:01.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.874+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58940ac500 con 0x7f586c0582e0 2020-07-16T20:31:01.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.877+0000 7f58867fc700 1 -- 172.21.15.157:0/3839856989 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82330 (secure 0 0 0) 0x7f58940ac500 con 0x7f586c0582e0 2020-07-16T20:31:01.880 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f586c0582e0 msgr2=0x7f586c05a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f586c0582e0 0x7f586c05a7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f588800e000 tx=0x7f5888008040).stop 2020-07-16T20:31:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 msgr2=0x7f586c004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 0x7f586c004e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f588c003270 tx=0x7f588c016000).stop 2020-07-16T20:31:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589ab72700 1 -- 172.21.15.157:0/3839856989 reap_dead start 2020-07-16T20:31:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 shutdown_connections 2020-07-16T20:31:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 --2- 172.21.15.157:0/3839856989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f586c0049d0 0x7f586c004e50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 >> 172.21.15.157:0/3839856989 conn(0x7f5894061820 msgr2=0x7f58941369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 shutdown_connections 2020-07-16T20:31:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.878+0000 7f589c5d5700 1 -- 172.21.15.157:0/3839856989 wait complete. 2020-07-16T20:31:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2020-07-16T20:31:01.890 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-07-16T20:31:00.550826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":833064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.819335"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934353+0000","last_change":"2020-07-16T20:30:50.929263+0000","last_active":"2020-07-16T20:30:50.934353+0000","last_peered":"2020-07-16T20:30:50.934353+0000","last_clean":"2020-07-16T20:30:50.934353+0000","last_became_active":"2020-07-16T20:30:50.928273+0000","last_became_peered":"2020-07-16T20:30:50.928273+0000","last_unstale":"2020-07-16T20:30:50.934353+0000","last_undegraded":"2020-07-16T20:30:50.934353+0000","last_fullsized":"2020-07-16T20:30:50.934353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.733535+0000","last_change":"2020-07-16T20:30:44.962204+0000","last_active":"2020-07-16T20:30:50.733535+0000","last_peered":"2020-07-16T20:30:50.733535+0000","last_clean":"2020-07-16T20:30:50.733535+0000","last_became_active":"2020-07-16T20:30:44.961763+0000","last_became_peered":"2020-07-16T20:30:44.961763+0000","last_unstale":"2020-07-16T20:30:50.733535+0000","last_undegraded":"2020-07-16T20:30:50.733535+0000","last_fullsized":"2020-07-16T20:30:50.733535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.758603+0000","last_change":"2020-07-16T20:30:47.717995+0000","last_active":"2020-07-16T20:30:53.758603+0000","last_peered":"2020-07-16T20:30:53.758603+0000","last_clean":"2020-07-16T20:30:53.758603+0000","last_became_active":"2020-07-16T20:30:47.717450+0000","last_became_peered":"2020-07-16T20:30:47.717450+0000","last_unstale":"2020-07-16T20:30:53.758603+0000","last_undegraded":"2020-07-16T20:30:53.758603+0000","last_fullsized":"2020-07-16T20:30:53.758603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934773+0000","last_change":"2020-07-16T20:30:50.930286+0000","last_active":"2020-07-16T20:30:50.934773+0000","last_peered":"2020-07-16T20:30:50.934773+0000","last_clean":"2020-07-16T20:30:50.934773+0000","last_became_active":"2020-07-16T20:30:50.929602+0000","last_became_peered":"2020-07-16T20:30:50.929602+0000","last_unstale":"2020-07-16T20:30:50.934773+0000","last_undegraded":"2020-07-16T20:30:50.934773+0000","last_fullsized":"2020-07-16T20:30:50.934773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735167+0000","last_change":"2020-07-16T20:30:44.962272+0000","last_active":"2020-07-16T20:30:50.735167+0000","last_peered":"2020-07-16T20:30:50.735167+0000","last_clean":"2020-07-16T20:30:50.735167+0000","last_became_active":"2020-07-16T20:30:44.961928+0000","last_became_peered":"2020-07-16T20:30:44.961928+0000","last_unstale":"2020-07-16T20:30:50.735167+0000","last_undegraded":"2020-07-16T20:30:50.735167+0000","last_fullsized":"2020-07-16T20:30:50.735167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.752563+0000","last_change":"2020-07-16T20:30:47.713854+0000","last_active":"2020-07-16T20:30:53.752563+0000","last_peered":"2020-07-16T20:30:53.752563+0000","last_clean":"2020-07-16T20:30:53.752563+0000","last_became_active":"2020-07-16T20:30:47.713550+0000","last_became_peered":"2020-07-16T20:30:47.713550+0000","last_unstale":"2020-07-16T20:30:53.752563+0000","last_undegraded":"2020-07-16T20:30:53.752563+0000","last_fullsized":"2020-07-16T20:30:53.752563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934332+0000","last_change":"2020-07-16T20:30:50.929119+0000","last_active":"2020-07-16T20:30:50.934332+0000","last_peered":"2020-07-16T20:30:50.934332+0000","last_clean":"2020-07-16T20:30:50.934332+0000","last_became_active":"2020-07-16T20:30:50.928367+0000","last_became_peered":"2020-07-16T20:30:50.928367+0000","last_unstale":"2020-07-16T20:30:50.934332+0000","last_undegraded":"2020-07-16T20:30:50.934332+0000","last_fullsized":"2020-07-16T20:30:50.934332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.926306+0000","last_change":"2020-07-16T20:30:44.693534+0000","last_active":"2020-07-16T20:30:50.926306+0000","last_peered":"2020-07-16T20:30:50.926306+0000","last_clean":"2020-07-16T20:30:50.926306+0000","last_became_active":"2020-07-16T20:30:44.693060+0000","last_became_peered":"2020-07-16T20:30:44.693060+0000","last_unstale":"2020-07-16T20:30:50.926306+0000","last_undegraded":"2020-07-16T20:30:50.926306+0000","last_fullsized":"2020-07-16T20:30:50.926306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761618+0000","last_change":"2020-07-16T20:30:47.969735+0000","last_active":"2020-07-16T20:30:53.761618+0000","last_peered":"2020-07-16T20:30:53.761618+0000","last_clean":"2020-07-16T20:30:53.761618+0000","last_became_active":"2020-07-16T20:30:47.969397+0000","last_became_peered":"2020-07-16T20:30:47.969397+0000","last_unstale":"2020-07-16T20:30:53.761618+0000","last_undegraded":"2020-07-16T20:30:53.761618+0000","last_fullsized":"2020-07-16T20:30:53.761618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.928282+0000","last_change":"2020-07-16T20:30:50.927407+0000","last_active":"2020-07-16T20:30:50.928282+0000","last_peered":"2020-07-16T20:30:50.928282+0000","last_clean":"2020-07-16T20:30:50.928282+0000","last_became_active":"2020-07-16T20:30:50.926714+0000","last_became_peered":"2020-07-16T20:30:50.926714+0000","last_unstale":"2020-07-16T20:30:50.928282+0000","last_undegraded":"2020-07-16T20:30:50.928282+0000","last_fullsized":"2020-07-16T20:30:50.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735228+0000","last_change":"2020-07-16T20:30:44.879472+0000","last_active":"2020-07-16T20:30:50.735228+0000","last_peered":"2020-07-16T20:30:50.735228+0000","last_clean":"2020-07-16T20:30:50.735228+0000","last_became_active":"2020-07-16T20:30:44.879044+0000","last_became_peered":"2020-07-16T20:30:44.879044+0000","last_unstale":"2020-07-16T20:30:50.735228+0000","last_undegraded":"2020-07-16T20:30:50.735228+0000","last_fullsized":"2020-07-16T20:30:50.735228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.811130+0000","last_change":"2020-07-16T20:30:39.886285+0000","last_active":"2020-07-16T20:30:50.811130+0000","last_peered":"2020-07-16T20:30:50.811130+0000","last_clean":"2020-07-16T20:30:50.811130+0000","last_became_active":"2020-07-16T20:30:39.885893+0000","last_became_peered":"2020-07-16T20:30:39.885893+0000","last_unstale":"2020-07-16T20:30:50.811130+0000","last_undegraded":"2020-07-16T20:30:50.811130+0000","last_fullsized":"2020-07-16T20:30:50.811130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_clean_scrub_stamp":"2020-07-16T20:30:32.595429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:51.531044+0000","last_change":"2020-07-16T20:30:47.717861+0000","last_active":"2020-07-16T20:30:51.531044+0000","last_peered":"2020-07-16T20:30:51.531044+0000","last_clean":"2020-07-16T20:30:51.531044+0000","last_became_active":"2020-07-16T20:30:47.717403+0000","last_became_peered":"2020-07-16T20:30:47.717403+0000","last_unstale":"2020-07-16T20:30:51.531044+0000","last_undegraded":"2020-07-16T20:30:51.531044+0000","last_fullsized":"2020-07-16T20:30:51.531044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.930822+0000","last_change":"2020-07-16T20:30:50.928755+0000","last_active":"2020-07-16T20:30:50.930822+0000","last_peered":"2020-07-16T20:30:50.930822+0000","last_clean":"2020-07-16T20:30:50.930822+0000","last_became_active":"2020-07-16T20:30:50.928124+0000","last_became_peered":"2020-07-16T20:30:50.928124+0000","last_unstale":"2020-07-16T20:30:50.930822+0000","last_undegraded":"2020-07-16T20:30:50.930822+0000","last_fullsized":"2020-07-16T20:30:50.930822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735124+0000","last_change":"2020-07-16T20:30:44.695156+0000","last_active":"2020-07-16T20:30:50.735124+0000","last_peered":"2020-07-16T20:30:50.735124+0000","last_clean":"2020-07-16T20:30:50.735124+0000","last_became_active":"2020-07-16T20:30:44.694873+0000","last_became_peered":"2020-07-16T20:30:44.694873+0000","last_unstale":"2020-07-16T20:30:50.735124+0000","last_undegraded":"2020-07-16T20:30:50.735124+0000","last_fullsized":"2020-07-16T20:30:50.735124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734862+0000","last_change":"2020-07-16T20:30:47.716604+0000","last_active":"2020-07-16T20:30:50.734862+0000","last_peered":"2020-07-16T20:30:50.734862+0000","last_clean":"2020-07-16T20:30:50.734862+0000","last_became_active":"2020-07-16T20:30:47.716172+0000","last_became_peered":"2020-07-16T20:30:47.716172+0000","last_unstale":"2020-07-16T20:30:50.734862+0000","last_undegraded":"2020-07-16T20:30:50.734862+0000","last_fullsized":"2020-07-16T20:30:50.734862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934749+0000","last_change":"2020-07-16T20:30:50.929889+0000","last_active":"2020-07-16T20:30:50.934749+0000","last_peered":"2020-07-16T20:30:50.934749+0000","last_clean":"2020-07-16T20:30:50.934749+0000","last_became_active":"2020-07-16T20:30:50.929189+0000","last_became_peered":"2020-07-16T20:30:50.929189+0000","last_unstale":"2020-07-16T20:30:50.934749+0000","last_undegraded":"2020-07-16T20:30:50.934749+0000","last_fullsized":"2020-07-16T20:30:50.934749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735992+0000","last_change":"2020-07-16T20:30:44.695179+0000","last_active":"2020-07-16T20:30:50.735992+0000","last_peered":"2020-07-16T20:30:50.735992+0000","last_clean":"2020-07-16T20:30:50.735992+0000","last_became_active":"2020-07-16T20:30:44.694857+0000","last_became_peered":"2020-07-16T20:30:44.694857+0000","last_unstale":"2020-07-16T20:30:50.735992+0000","last_undegraded":"2020-07-16T20:30:50.735992+0000","last_fullsized":"2020-07-16T20:30:50.735992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761507+0000","last_change":"2020-07-16T20:30:47.719857+0000","last_active":"2020-07-16T20:30:53.761507+0000","last_peered":"2020-07-16T20:30:53.761507+0000","last_clean":"2020-07-16T20:30:53.761507+0000","last_became_active":"2020-07-16T20:30:47.719440+0000","last_became_peered":"2020-07-16T20:30:47.719440+0000","last_unstale":"2020-07-16T20:30:53.761507+0000","last_undegraded":"2020-07-16T20:30:53.761507+0000","last_fullsized":"2020-07-16T20:30:53.761507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.816507+0000","last_change":"2020-07-16T20:30:50.813452+0000","last_active":"2020-07-16T20:30:50.816507+0000","last_peered":"2020-07-16T20:30:50.816507+0000","last_clean":"2020-07-16T20:30:50.816507+0000","last_became_active":"2020-07-16T20:30:50.812786+0000","last_became_peered":"2020-07-16T20:30:50.812786+0000","last_unstale":"2020-07-16T20:30:50.816507+0000","last_undegraded":"2020-07-16T20:30:50.816507+0000","last_fullsized":"2020-07-16T20:30:50.816507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.759108+0000","last_change":"2020-07-16T20:30:47.718207+0000","last_active":"2020-07-16T20:30:53.759108+0000","last_peered":"2020-07-16T20:30:53.759108+0000","last_clean":"2020-07-16T20:30:53.759108+0000","last_became_active":"2020-07-16T20:30:47.717750+0000","last_became_peered":"2020-07-16T20:30:47.717750+0000","last_unstale":"2020-07-16T20:30:53.759108+0000","last_undegraded":"2020-07-16T20:30:53.759108+0000","last_fullsized":"2020-07-16T20:30:53.759108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734870+0000","last_change":"2020-07-16T20:30:44.728373+0000","last_active":"2020-07-16T20:30:50.734870+0000","last_peered":"2020-07-16T20:30:50.734870+0000","last_clean":"2020-07-16T20:30:50.734870+0000","last_became_active":"2020-07-16T20:30:44.727914+0000","last_became_peered":"2020-07-16T20:30:44.727914+0000","last_unstale":"2020-07-16T20:30:50.734870+0000","last_undegraded":"2020-07-16T20:30:50.734870+0000","last_fullsized":"2020-07-16T20:30:50.734870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.814909+0000","last_change":"2020-07-16T20:30:50.814285+0000","last_active":"2020-07-16T20:30:50.814909+0000","last_peered":"2020-07-16T20:30:50.814909+0000","last_clean":"2020-07-16T20:30:50.814909+0000","last_became_active":"2020-07-16T20:30:50.812831+0000","last_became_peered":"2020-07-16T20:30:50.812831+0000","last_unstale":"2020-07-16T20:30:50.814909+0000","last_undegraded":"2020-07-16T20:30:50.814909+0000","last_fullsized":"2020-07-16T20:30:50.814909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735926+0000","last_change":"2020-07-16T20:30:44.727996+0000","last_active":"2020-07-16T20:30:50.735926+0000","last_peered":"2020-07-16T20:30:50.735926+0000","last_clean":"2020-07-16T20:30:50.735926+0000","last_became_active":"2020-07-16T20:30:44.727593+0000","last_became_peered":"2020-07-16T20:30:44.727593+0000","last_unstale":"2020-07-16T20:30:50.735926+0000","last_undegraded":"2020-07-16T20:30:50.735926+0000","last_fullsized":"2020-07-16T20:30:50.735926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.756760+0000","last_change":"2020-07-16T20:30:47.969976+0000","last_active":"2020-07-16T20:30:53.756760+0000","last_peered":"2020-07-16T20:30:53.756760+0000","last_clean":"2020-07-16T20:30:53.756760+0000","last_became_active":"2020-07-16T20:30:47.969384+0000","last_became_peered":"2020-07-16T20:30:47.969384+0000","last_unstale":"2020-07-16T20:30:53.756760+0000","last_undegraded":"2020-07-16T20:30:53.756760+0000","last_fullsized":"2020-07-16T20:30:53.756760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":105092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}]}} 2020-07-16T20:31:01.893 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:31:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 Processor -- start 2020-07-16T20:31:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- start start 2020-07-16T20:31:02.002 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b3c0a3d40 0x7f5b3c0a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.002 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0a2be0 con 0x7f5b3c138db0 2020-07-16T20:31:02.002 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0a2e80 con 0x7f5b3c067f60 2020-07-16T20:31:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a21c0 con 0x7f5b3c0a3d40 2020-07-16T20:31:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3a59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b3c0a3d40 0x7f5b3c0a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3ad9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5b3c067f60 0x7f5b3c1400f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36860/0 (socket says 172.21.15.157:36860) 2020-07-16T20:31:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3ad9d700 1 -- 172.21.15.157:0/2430134405 learned_addr learned my addr 172.21.15.157:0/2430134405 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3a59c700 1 -- 172.21.15.157:0/2430134405 >> v1:172.21.15.157:6789/0 conn(0x7f5b3c067f60 legacy=0x7f5b3c1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3a59c700 1 -- 172.21.15.157:0/2430134405 >> v1:172.21.15.41:6789/0 conn(0x7f5b3c138db0 legacy=0x7f5b3c067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3959a700 1 -- 172.21.15.157:0/2430134405 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267899780 0 0) 0x7f5b3c0a2e80 con 0x7f5b3c067f60 2020-07-16T20:31:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3a59c700 1 -- 172.21.15.157:0/2430134405 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c139240 con 0x7f5b3c0a3d40 2020-07-16T20:31:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3a59c700 1 --2- 172.21.15.157:0/2430134405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c0a3d40 0x7f5b3c0a8b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5b2c002f30 tx=0x7f5b2c006dd0).ready entity=mon.1 client_cookie=6156946470f7bcfe server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3959a700 1 -- 172.21.15.157:0/2430134405 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2c009880 con 0x7f5b3c0a3d40 2020-07-16T20:31:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3959a700 1 -- 172.21.15.157:0/2430134405 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0099e0 con 0x7f5b3c0a3d40 2020-07-16T20:31:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3959a700 1 -- 172.21.15.157:0/2430134405 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2c009d40 con 0x7f5b3c0a3d40 2020-07-16T20:31:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- 172.21.15.157:0/2430134405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c0a3d40 msgr2=0x7f5b3c0a8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/2430134405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c0a3d40 0x7f5b3c0a8b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5b2c002f30 tx=0x7f5b2c006dd0).stop 2020-07-16T20:31:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- 172.21.15.157:0/2430134405 shutdown_connections 2020-07-16T20:31:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/2430134405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c0a3d40 0x7f5b3c0a8b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- 172.21.15.157:0/2430134405 >> 172.21.15.157:0/2430134405 conn(0x7f5b3c05b810 msgr2=0x7f5b3c05bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- 172.21.15.157:0/2430134405 shutdown_connections 2020-07-16T20:31:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:01.999+0000 7f5b3b59e700 1 -- 172.21.15.157:0/2430134405 wait complete. 2020-07-16T20:31:02.007 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 Processor -- start 2020-07-16T20:31:02.007 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 -- start start 2020-07-16T20:31:02.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5b3c067f60 0x7f5b3c062200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5b3c138db0 0x7f5b3c0a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b3c09f500 0x7f5b3c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c09fa80 con 0x7f5b3c067f60 2020-07-16T20:31:02.010 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c09fd20 con 0x7f5b3c09f500 2020-07-16T20:31:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3b59e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a1040 con 0x7f5b3c138db0 2020-07-16T20:31:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b3c09f500 0x7f5b3c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b3c09f500 0x7f5b3c147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34180/0 (socket says 172.21.15.157:34180) 2020-07-16T20:31:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3ad9d700 1 -- 172.21.15.157:0/634607545 learned_addr learned my addr 172.21.15.157:0/634607545 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:02.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b3a59c700 1 --2- 172.21.15.157:0/634607545 >> v2:172.21.15.41:3300/0 conn(0x7f5b3c067f60 0x7f5b3c062200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.001+0000 7f5b39d9b700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5b3c138db0 0x7f5b3c0a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 -- 172.21.15.157:0/634607545 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5b3c138db0 msgr2=0x7f5b3c0a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5b3c138db0 0x7f5b3c0a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 -- 172.21.15.157:0/634607545 >> v2:172.21.15.41:3300/0 conn(0x7f5b3c067f60 msgr2=0x7f5b3c062200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 --2- 172.21.15.157:0/634607545 >> v2:172.21.15.41:3300/0 conn(0x7f5b3c067f60 0x7f5b3c062200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 -- 172.21.15.157:0/634607545 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c1483d0 con 0x7f5b3c09f500 2020-07-16T20:31:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3ad9d700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c09f500 0x7f5b3c147ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5b34001210 tx=0x7f5b34007d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b3400ce60 con 0x7f5b3c09f500 2020-07-16T20:31:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34005b80 con 0x7f5b3c09f500 2020-07-16T20:31:02.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c148620 con 0x7f5b3c09f500 2020-07-16T20:31:02.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b34004880 con 0x7f5b3c09f500 2020-07-16T20:31:02.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.002+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c066c30 con 0x7f5b3c09f500 2020-07-16T20:31:02.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.003+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c0a0130 con 0x7f5b3c09f500 2020-07-16T20:31:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.003+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5b3401b060 con 0x7f5b3c09f500 2020-07-16T20:31:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.003+0000 7f5b2a7fc700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 0x7f5b10052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.003+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5b34067680 con 0x7f5b3c09f500 2020-07-16T20:31:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.003+0000 7f5b3a59c700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 0x7f5b10052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.004+0000 7f5b3a59c700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 0x7f5b10052490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5b2c01c000 tx=0x7f5b2c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.007+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5b3c0a0130 con 0x7f5b3c09f500 2020-07-16T20:31:02.152 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.151+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b3c0a0130 con 0x7f5b1004ffd0 2020-07-16T20:31:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.153+0000 7f5b2a7fc700 1 -- 172.21.15.157:0/634607545 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82330 (secure 0 0 0) 0x7f5b3c0a0130 con 0x7f5b1004ffd0 2020-07-16T20:31:02.156 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:02.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 msgr2=0x7f5b10052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 0x7f5b10052490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5b2c01c000 tx=0x7f5b2c015000).stop 2020-07-16T20:31:02.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c09f500 msgr2=0x7f5b3c147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c09f500 0x7f5b3c147ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5b34001210 tx=0x7f5b34007d00).stop 2020-07-16T20:31:02.159 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 shutdown_connections 2020-07-16T20:31:02.159 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5b1004ffd0 0x7f5b10052490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.159 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3c09f500 0x7f5b3c147ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.159 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> v2:172.21.15.41:3300/0 conn(0x7f5b3c067f60 0x7f5b3c062200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.159 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 --2- 172.21.15.157:0/634607545 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5b3c138db0 0x7f5b3c0a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.160 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 >> 172.21.15.157:0/634607545 conn(0x7f5b3c05b810 msgr2=0x7f5b3c136170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.160 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 shutdown_connections 2020-07-16T20:31:02.160 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.155+0000 7f5b3b59e700 1 -- 172.21.15.157:0/634607545 wait complete. 2020-07-16T20:31:02.160 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2020-07-16T20:31:02.167 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-07-16T20:31:00.550826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":833064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.819335"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934353+0000","last_change":"2020-07-16T20:30:50.929263+0000","last_active":"2020-07-16T20:30:50.934353+0000","last_peered":"2020-07-16T20:30:50.934353+0000","last_clean":"2020-07-16T20:30:50.934353+0000","last_became_active":"2020-07-16T20:30:50.928273+0000","last_became_peered":"2020-07-16T20:30:50.928273+0000","last_unstale":"2020-07-16T20:30:50.934353+0000","last_undegraded":"2020-07-16T20:30:50.934353+0000","last_fullsized":"2020-07-16T20:30:50.934353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.733535+0000","last_change":"2020-07-16T20:30:44.962204+0000","last_active":"2020-07-16T20:30:50.733535+0000","last_peered":"2020-07-16T20:30:50.733535+0000","last_clean":"2020-07-16T20:30:50.733535+0000","last_became_active":"2020-07-16T20:30:44.961763+0000","last_became_peered":"2020-07-16T20:30:44.961763+0000","last_unstale":"2020-07-16T20:30:50.733535+0000","last_undegraded":"2020-07-16T20:30:50.733535+0000","last_fullsized":"2020-07-16T20:30:50.733535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.758603+0000","last_change":"2020-07-16T20:30:47.717995+0000","last_active":"2020-07-16T20:30:53.758603+0000","last_peered":"2020-07-16T20:30:53.758603+0000","last_clean":"2020-07-16T20:30:53.758603+0000","last_became_active":"2020-07-16T20:30:47.717450+0000","last_became_peered":"2020-07-16T20:30:47.717450+0000","last_unstale":"2020-07-16T20:30:53.758603+0000","last_undegraded":"2020-07-16T20:30:53.758603+0000","last_fullsized":"2020-07-16T20:30:53.758603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934773+0000","last_change":"2020-07-16T20:30:50.930286+0000","last_active":"2020-07-16T20:30:50.934773+0000","last_peered":"2020-07-16T20:30:50.934773+0000","last_clean":"2020-07-16T20:30:50.934773+0000","last_became_active":"2020-07-16T20:30:50.929602+0000","last_became_peered":"2020-07-16T20:30:50.929602+0000","last_unstale":"2020-07-16T20:30:50.934773+0000","last_undegraded":"2020-07-16T20:30:50.934773+0000","last_fullsized":"2020-07-16T20:30:50.934773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735167+0000","last_change":"2020-07-16T20:30:44.962272+0000","last_active":"2020-07-16T20:30:50.735167+0000","last_peered":"2020-07-16T20:30:50.735167+0000","last_clean":"2020-07-16T20:30:50.735167+0000","last_became_active":"2020-07-16T20:30:44.961928+0000","last_became_peered":"2020-07-16T20:30:44.961928+0000","last_unstale":"2020-07-16T20:30:50.735167+0000","last_undegraded":"2020-07-16T20:30:50.735167+0000","last_fullsized":"2020-07-16T20:30:50.735167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.752563+0000","last_change":"2020-07-16T20:30:47.713854+0000","last_active":"2020-07-16T20:30:53.752563+0000","last_peered":"2020-07-16T20:30:53.752563+0000","last_clean":"2020-07-16T20:30:53.752563+0000","last_became_active":"2020-07-16T20:30:47.713550+0000","last_became_peered":"2020-07-16T20:30:47.713550+0000","last_unstale":"2020-07-16T20:30:53.752563+0000","last_undegraded":"2020-07-16T20:30:53.752563+0000","last_fullsized":"2020-07-16T20:30:53.752563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934332+0000","last_change":"2020-07-16T20:30:50.929119+0000","last_active":"2020-07-16T20:30:50.934332+0000","last_peered":"2020-07-16T20:30:50.934332+0000","last_clean":"2020-07-16T20:30:50.934332+0000","last_became_active":"2020-07-16T20:30:50.928367+0000","last_became_peered":"2020-07-16T20:30:50.928367+0000","last_unstale":"2020-07-16T20:30:50.934332+0000","last_undegraded":"2020-07-16T20:30:50.934332+0000","last_fullsized":"2020-07-16T20:30:50.934332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.926306+0000","last_change":"2020-07-16T20:30:44.693534+0000","last_active":"2020-07-16T20:30:50.926306+0000","last_peered":"2020-07-16T20:30:50.926306+0000","last_clean":"2020-07-16T20:30:50.926306+0000","last_became_active":"2020-07-16T20:30:44.693060+0000","last_became_peered":"2020-07-16T20:30:44.693060+0000","last_unstale":"2020-07-16T20:30:50.926306+0000","last_undegraded":"2020-07-16T20:30:50.926306+0000","last_fullsized":"2020-07-16T20:30:50.926306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761618+0000","last_change":"2020-07-16T20:30:47.969735+0000","last_active":"2020-07-16T20:30:53.761618+0000","last_peered":"2020-07-16T20:30:53.761618+0000","last_clean":"2020-07-16T20:30:53.761618+0000","last_became_active":"2020-07-16T20:30:47.969397+0000","last_became_peered":"2020-07-16T20:30:47.969397+0000","last_unstale":"2020-07-16T20:30:53.761618+0000","last_undegraded":"2020-07-16T20:30:53.761618+0000","last_fullsized":"2020-07-16T20:30:53.761618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.928282+0000","last_change":"2020-07-16T20:30:50.927407+0000","last_active":"2020-07-16T20:30:50.928282+0000","last_peered":"2020-07-16T20:30:50.928282+0000","last_clean":"2020-07-16T20:30:50.928282+0000","last_became_active":"2020-07-16T20:30:50.926714+0000","last_became_peered":"2020-07-16T20:30:50.926714+0000","last_unstale":"2020-07-16T20:30:50.928282+0000","last_undegraded":"2020-07-16T20:30:50.928282+0000","last_fullsized":"2020-07-16T20:30:50.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735228+0000","last_change":"2020-07-16T20:30:44.879472+0000","last_active":"2020-07-16T20:30:50.735228+0000","last_peered":"2020-07-16T20:30:50.735228+0000","last_clean":"2020-07-16T20:30:50.735228+0000","last_became_active":"2020-07-16T20:30:44.879044+0000","last_became_peered":"2020-07-16T20:30:44.879044+0000","last_unstale":"2020-07-16T20:30:50.735228+0000","last_undegraded":"2020-07-16T20:30:50.735228+0000","last_fullsized":"2020-07-16T20:30:50.735228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.811130+0000","last_change":"2020-07-16T20:30:39.886285+0000","last_active":"2020-07-16T20:30:50.811130+0000","last_peered":"2020-07-16T20:30:50.811130+0000","last_clean":"2020-07-16T20:30:50.811130+0000","last_became_active":"2020-07-16T20:30:39.885893+0000","last_became_peered":"2020-07-16T20:30:39.885893+0000","last_unstale":"2020-07-16T20:30:50.811130+0000","last_undegraded":"2020-07-16T20:30:50.811130+0000","last_fullsized":"2020-07-16T20:30:50.811130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_clean_scrub_stamp":"2020-07-16T20:30:32.595429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:51.531044+0000","last_change":"2020-07-16T20:30:47.717861+0000","last_active":"2020-07-16T20:30:51.531044+0000","last_peered":"2020-07-16T20:30:51.531044+0000","last_clean":"2020-07-16T20:30:51.531044+0000","last_became_active":"2020-07-16T20:30:47.717403+0000","last_became_peered":"2020-07-16T20:30:47.717403+0000","last_unstale":"2020-07-16T20:30:51.531044+0000","last_undegraded":"2020-07-16T20:30:51.531044+0000","last_fullsized":"2020-07-16T20:30:51.531044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.930822+0000","last_change":"2020-07-16T20:30:50.928755+0000","last_active":"2020-07-16T20:30:50.930822+0000","last_peered":"2020-07-16T20:30:50.930822+0000","last_clean":"2020-07-16T20:30:50.930822+0000","last_became_active":"2020-07-16T20:30:50.928124+0000","last_became_peered":"2020-07-16T20:30:50.928124+0000","last_unstale":"2020-07-16T20:30:50.930822+0000","last_undegraded":"2020-07-16T20:30:50.930822+0000","last_fullsized":"2020-07-16T20:30:50.930822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735124+0000","last_change":"2020-07-16T20:30:44.695156+0000","last_active":"2020-07-16T20:30:50.735124+0000","last_peered":"2020-07-16T20:30:50.735124+0000","last_clean":"2020-07-16T20:30:50.735124+0000","last_became_active":"2020-07-16T20:30:44.694873+0000","last_became_peered":"2020-07-16T20:30:44.694873+0000","last_unstale":"2020-07-16T20:30:50.735124+0000","last_undegraded":"2020-07-16T20:30:50.735124+0000","last_fullsized":"2020-07-16T20:30:50.735124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734862+0000","last_change":"2020-07-16T20:30:47.716604+0000","last_active":"2020-07-16T20:30:50.734862+0000","last_peered":"2020-07-16T20:30:50.734862+0000","last_clean":"2020-07-16T20:30:50.734862+0000","last_became_active":"2020-07-16T20:30:47.716172+0000","last_became_peered":"2020-07-16T20:30:47.716172+0000","last_unstale":"2020-07-16T20:30:50.734862+0000","last_undegraded":"2020-07-16T20:30:50.734862+0000","last_fullsized":"2020-07-16T20:30:50.734862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934749+0000","last_change":"2020-07-16T20:30:50.929889+0000","last_active":"2020-07-16T20:30:50.934749+0000","last_peered":"2020-07-16T20:30:50.934749+0000","last_clean":"2020-07-16T20:30:50.934749+0000","last_became_active":"2020-07-16T20:30:50.929189+0000","last_became_peered":"2020-07-16T20:30:50.929189+0000","last_unstale":"2020-07-16T20:30:50.934749+0000","last_undegraded":"2020-07-16T20:30:50.934749+0000","last_fullsized":"2020-07-16T20:30:50.934749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735992+0000","last_change":"2020-07-16T20:30:44.695179+0000","last_active":"2020-07-16T20:30:50.735992+0000","last_peered":"2020-07-16T20:30:50.735992+0000","last_clean":"2020-07-16T20:30:50.735992+0000","last_became_active":"2020-07-16T20:30:44.694857+0000","last_became_peered":"2020-07-16T20:30:44.694857+0000","last_unstale":"2020-07-16T20:30:50.735992+0000","last_undegraded":"2020-07-16T20:30:50.735992+0000","last_fullsized":"2020-07-16T20:30:50.735992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761507+0000","last_change":"2020-07-16T20:30:47.719857+0000","last_active":"2020-07-16T20:30:53.761507+0000","last_peered":"2020-07-16T20:30:53.761507+0000","last_clean":"2020-07-16T20:30:53.761507+0000","last_became_active":"2020-07-16T20:30:47.719440+0000","last_became_peered":"2020-07-16T20:30:47.719440+0000","last_unstale":"2020-07-16T20:30:53.761507+0000","last_undegraded":"2020-07-16T20:30:53.761507+0000","last_fullsized":"2020-07-16T20:30:53.761507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.816507+0000","last_change":"2020-07-16T20:30:50.813452+0000","last_active":"2020-07-16T20:30:50.816507+0000","last_peered":"2020-07-16T20:30:50.816507+0000","last_clean":"2020-07-16T20:30:50.816507+0000","last_became_active":"2020-07-16T20:30:50.812786+0000","last_became_peered":"2020-07-16T20:30:50.812786+0000","last_unstale":"2020-07-16T20:30:50.816507+0000","last_undegraded":"2020-07-16T20:30:50.816507+0000","last_fullsized":"2020-07-16T20:30:50.816507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.759108+0000","last_change":"2020-07-16T20:30:47.718207+0000","last_active":"2020-07-16T20:30:53.759108+0000","last_peered":"2020-07-16T20:30:53.759108+0000","last_clean":"2020-07-16T20:30:53.759108+0000","last_became_active":"2020-07-16T20:30:47.717750+0000","last_became_peered":"2020-07-16T20:30:47.717750+0000","last_unstale":"2020-07-16T20:30:53.759108+0000","last_undegraded":"2020-07-16T20:30:53.759108+0000","last_fullsized":"2020-07-16T20:30:53.759108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734870+0000","last_change":"2020-07-16T20:30:44.728373+0000","last_active":"2020-07-16T20:30:50.734870+0000","last_peered":"2020-07-16T20:30:50.734870+0000","last_clean":"2020-07-16T20:30:50.734870+0000","last_became_active":"2020-07-16T20:30:44.727914+0000","last_became_peered":"2020-07-16T20:30:44.727914+0000","last_unstale":"2020-07-16T20:30:50.734870+0000","last_undegraded":"2020-07-16T20:30:50.734870+0000","last_fullsized":"2020-07-16T20:30:50.734870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.814909+0000","last_change":"2020-07-16T20:30:50.814285+0000","last_active":"2020-07-16T20:30:50.814909+0000","last_peered":"2020-07-16T20:30:50.814909+0000","last_clean":"2020-07-16T20:30:50.814909+0000","last_became_active":"2020-07-16T20:30:50.812831+0000","last_became_peered":"2020-07-16T20:30:50.812831+0000","last_unstale":"2020-07-16T20:30:50.814909+0000","last_undegraded":"2020-07-16T20:30:50.814909+0000","last_fullsized":"2020-07-16T20:30:50.814909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735926+0000","last_change":"2020-07-16T20:30:44.727996+0000","last_active":"2020-07-16T20:30:50.735926+0000","last_peered":"2020-07-16T20:30:50.735926+0000","last_clean":"2020-07-16T20:30:50.735926+0000","last_became_active":"2020-07-16T20:30:44.727593+0000","last_became_peered":"2020-07-16T20:30:44.727593+0000","last_unstale":"2020-07-16T20:30:50.735926+0000","last_undegraded":"2020-07-16T20:30:50.735926+0000","last_fullsized":"2020-07-16T20:30:50.735926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.756760+0000","last_change":"2020-07-16T20:30:47.969976+0000","last_active":"2020-07-16T20:30:53.756760+0000","last_peered":"2020-07-16T20:30:53.756760+0000","last_clean":"2020-07-16T20:30:53.756760+0000","last_became_active":"2020-07-16T20:30:47.969384+0000","last_became_peered":"2020-07-16T20:30:47.969384+0000","last_unstale":"2020-07-16T20:30:53.756760+0000","last_undegraded":"2020-07-16T20:30:53.756760+0000","last_fullsized":"2020-07-16T20:30:53.756760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":105092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}]}} 2020-07-16T20:31:02.169 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-07-16T20:31:02.170 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-07-16T20:31:02.171 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-07-16T20:31:02.172 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-07-16T20:31:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 Processor -- start 2020-07-16T20:31:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 -- start start 2020-07-16T20:31:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f828c0a86c0 0x7f828c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 0x7f828c133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0a5450 con 0x7f828c0a48e0 2020-07-16T20:31:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0a7880 con 0x7f828c132c80 2020-07-16T20:31:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f8291d8f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0a56b0 con 0x7f828c0a86c0 2020-07-16T20:31:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f828affd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f828c0a86c0 0x7f828c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f828b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f828c0a48e0 0x7f828c0a7fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36872/0 (socket says 172.21.15.157:36872) 2020-07-16T20:31:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.276+0000 7f828b7fe700 1 -- 172.21.15.157:0/3933204623 learned_addr learned my addr 172.21.15.157:0/3933204623 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828bfff700 1 --2- 172.21.15.157:0/3933204623 >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 0x7f828c133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828affd700 1 -- 172.21.15.157:0/3933204623 >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 msgr2=0x7f828c133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828affd700 1 --2- 172.21.15.157:0/3933204623 >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 0x7f828c133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828affd700 1 -- 172.21.15.157:0/3933204623 >> v1:172.21.15.157:6789/0 conn(0x7f828c0a48e0 legacy=0x7f828c0a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828affd700 1 -- 172.21.15.157:0/3933204623 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0a5950 con 0x7f828c0a86c0 2020-07-16T20:31:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828a7fc700 1 -- 172.21.15.157:0/3933204623 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789392371 0 0) 0x7f828c0a5450 con 0x7f828c0a48e0 2020-07-16T20:31:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828bfff700 1 --2- 172.21.15.157:0/3933204623 >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 0x7f828c133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828affd700 1 --2- 172.21.15.157:0/3933204623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a86c0 0x7f828c0a4cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8280002f30 tx=0x7f8280006dd0).ready entity=mon.1 client_cookie=ec152983125fcd2a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828a7fc700 1 -- 172.21.15.157:0/3933204623 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82800097f0 con 0x7f828c0a86c0 2020-07-16T20:31:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828a7fc700 1 -- 172.21.15.157:0/3933204623 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280009950 con 0x7f828c0a86c0 2020-07-16T20:31:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f828a7fc700 1 -- 172.21.15.157:0/3933204623 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8280009cb0 con 0x7f828c0a86c0 2020-07-16T20:31:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 -- 172.21.15.157:0/3933204623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a86c0 msgr2=0x7f828c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 --2- 172.21.15.157:0/3933204623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a86c0 0x7f828c0a4cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8280002f30 tx=0x7f8280006dd0).stop 2020-07-16T20:31:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 -- 172.21.15.157:0/3933204623 shutdown_connections 2020-07-16T20:31:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 --2- 172.21.15.157:0/3933204623 >> v2:172.21.15.41:3300/0 conn(0x7f828c132c80 0x7f828c133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 --2- 172.21.15.157:0/3933204623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a86c0 0x7f828c0a4cc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 -- 172.21.15.157:0/3933204623 >> 172.21.15.157:0/3933204623 conn(0x7f828c061820 msgr2=0x7f828c09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 -- 172.21.15.157:0/3933204623 shutdown_connections 2020-07-16T20:31:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.277+0000 7f8291d8f700 1 -- 172.21.15.157:0/3933204623 wait complete. 2020-07-16T20:31:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 Processor -- start 2020-07-16T20:31:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 -- start start 2020-07-16T20:31:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f828c0a48e0 0x7f828c1251b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f828c12f970 0x7f828c123ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0aaab0 con 0x7f828c132c80 2020-07-16T20:31:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0aad50 con 0x7f828c0a48e0 2020-07-16T20:31:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f8291d8f700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0aaff0 con 0x7f828c12f970 2020-07-16T20:31:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f828b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f828c0a48e0 0x7f828c1251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f828affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f828c132c80 0x7f828c126070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36880/0 (socket says 172.21.15.157:36880) 2020-07-16T20:31:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.279+0000 7f828affd700 1 -- 172.21.15.157:0/759447570 learned_addr learned my addr 172.21.15.157:0/759447570 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f828b7fe700 1 -- 172.21.15.157:0/759447570 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f828c12f970 msgr2=0x7f828c123ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f828b7fe700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f828c12f970 0x7f828c123ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:31:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574229312 0 0) 0x7f828c0aaab0 con 0x7f828c132c80 2020-07-16T20:31:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f828b7fe700 1 -- 172.21.15.157:0/759447570 >> v1:172.21.15.157:6789/0 conn(0x7f828c132c80 legacy=0x7f828c126070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f828b7fe700 1 -- 172.21.15.157:0/759447570 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0ab290 con 0x7f828c0a48e0 2020-07-16T20:31:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f828b7fe700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a48e0 0x7f828c1251b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8284000f00 tx=0x7f8284007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8284005b80 con 0x7f828c0a48e0 2020-07-16T20:31:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284005ce0 con 0x7f828c0a48e0 2020-07-16T20:31:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c0a9620 con 0x7f828c0a48e0 2020-07-16T20:31:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8284007300 con 0x7f828c0a48e0 2020-07-16T20:31:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.280+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c1298e0 con 0x7f828c0a48e0 2020-07-16T20:31:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.281+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c057490 con 0x7f828c0a48e0 2020-07-16T20:31:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.281+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8284010030 con 0x7f828c0a48e0 2020-07-16T20:31:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.282+0000 7f826b7fe700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 0x7f8264052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.282+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f82840683c0 con 0x7f828c0a48e0 2020-07-16T20:31:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.282+0000 7f828affd700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 0x7f8264052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.282+0000 7f828affd700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 0x7f8264052370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8280000b80 tx=0x7f8280015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.285+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f8284040ab0 con 0x7f828c0a48e0 2020-07-16T20:31:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.485+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f828c0a2c30 con 0x7f828c0a48e0 2020-07-16T20:31:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.486+0000 7f826b7fe700 1 -- 172.21.15.157:0/759447570 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f82840440d0 con 0x7f828c0a48e0 2020-07-16T20:31:02.488 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 msgr2=0x7f8264052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 0x7f8264052370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8280000b80 tx=0x7f8280015000).stop 2020-07-16T20:31:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a48e0 msgr2=0x7f828c1251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a48e0 0x7f828c1251b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8284000f00 tx=0x7f8284007ca0).stop 2020-07-16T20:31:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 shutdown_connections 2020-07-16T20:31:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f826404feb0 0x7f8264052370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f828c12f970 0x7f828c123ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-07-16T20:31:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 --2- 172.21.15.157:0/759447570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828c0a48e0 0x7f828c1251b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 >> 172.21.15.157:0/759447570 conn(0x7f828c061820 msgr2=0x7f828c133110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 shutdown_connections 2020-07-16T20:31:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.487+0000 7f8291d8f700 1 -- 172.21.15.157:0/759447570 wait complete. 2020-07-16T20:31:02.499 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-07-16T20:31:02.499 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-07-16T20:31:02.500 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:31:02.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 Processor -- start 2020-07-16T20:31:02.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- start start 2020-07-16T20:31:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8b780a2ed0 0x7f8b780a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 0x7f8b781333d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b78068260 con 0x7f8b780a7290 2020-07-16T20:31:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b78067b20 con 0x7f8b78132f40 2020-07-16T20:31:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b78067dc0 con 0x7f8b780a2ed0 2020-07-16T20:31:02.617 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8b780a2ed0 0x7f8b780a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.617 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8b780a2ed0 0x7f8b780a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34202/0 (socket says 172.21.15.157:34202) 2020-07-16T20:31:02.617 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 -- 172.21.15.157:0/2759510309 learned_addr learned my addr 172.21.15.157:0/2759510309 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:02.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b777fe700 1 --2- 172.21.15.157:0/2759510309 >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 0x7f8b781333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 -- 172.21.15.157:0/2759510309 >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 msgr2=0x7f8b781333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:02.618 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 --2- 172.21.15.157:0/2759510309 >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 0x7f8b781333d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 -- 172.21.15.157:0/2759510309 >> v1:172.21.15.41:6789/0 conn(0x7f8b780a7290 legacy=0x7f8b7809ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:02.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 -- 172.21.15.157:0/2759510309 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780a7670 con 0x7f8b780a2ed0 2020-07-16T20:31:02.619 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b777fe700 1 --2- 172.21.15.157:0/2759510309 >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 0x7f8b781333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b767fc700 1 --2- 172.21.15.157:0/2759510309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b780a2ed0 0x7f8b780a3330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8b7805c550 tx=0x7f8b6c009270).ready entity=mon.1 client_cookie=ed93ca534d44fc78 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b75ffb700 1 -- 172.21.15.157:0/2759510309 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6c00bbc0 con 0x7f8b780a2ed0 2020-07-16T20:31:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b75ffb700 1 -- 172.21.15.157:0/2759510309 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00bd20 con 0x7f8b780a2ed0 2020-07-16T20:31:02.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b75ffb700 1 -- 172.21.15.157:0/2759510309 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6c00be90 con 0x7f8b780a2ed0 2020-07-16T20:31:02.621 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- 172.21.15.157:0/2759510309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b780a2ed0 msgr2=0x7f8b780a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 --2- 172.21.15.157:0/2759510309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b780a2ed0 0x7f8b780a3330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8b7805c550 tx=0x7f8b6c009270).stop 2020-07-16T20:31:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- 172.21.15.157:0/2759510309 shutdown_connections 2020-07-16T20:31:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 --2- 172.21.15.157:0/2759510309 >> v2:172.21.15.41:3300/0 conn(0x7f8b78132f40 0x7f8b781333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 --2- 172.21.15.157:0/2759510309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b780a2ed0 0x7f8b780a3330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- 172.21.15.157:0/2759510309 >> 172.21.15.157:0/2759510309 conn(0x7f8b7805b810 msgr2=0x7f8b7805bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- 172.21.15.157:0/2759510309 shutdown_connections 2020-07-16T20:31:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.607+0000 7f8b77fff700 1 -- 172.21.15.157:0/2759510309 wait complete. 2020-07-16T20:31:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 Processor -- start 2020-07-16T20:31:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 -- start start 2020-07-16T20:31:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b7812f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b7812cad0 0x7f8b7812ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780a1c40 con 0x7f8b780a7290 2020-07-16T20:31:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b78061cd0 con 0x7f8b7812cad0 2020-07-16T20:31:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b77fff700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7812d3c0 con 0x7f8b78132f40 2020-07-16T20:31:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b76ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8b780a7290 0x7f8b780615c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36892/0 (socket says 172.21.15.157:36892) 2020-07-16T20:31:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.609+0000 7f8b76ffd700 1 -- 172.21.15.157:0/1307085405 learned_addr learned my addr 172.21.15.157:0/1307085405 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197397307 0 0) 0x7f8b780a1c40 con 0x7f8b780a7290 2020-07-16T20:31:02.627 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b54003240 con 0x7f8b780a7290 2020-07-16T20:31:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 --2- 172.21.15.157:0/1307085405 >> v2:172.21.15.41:3300/0 conn(0x7f8b7812cad0 0x7f8b7812ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b767fc700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b7812f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2798912040 0 0) 0x7f8b54003240 con 0x7f8b780a7290 2020-07-16T20:31:02.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b780a1c40 con 0x7f8b780a7290 2020-07-16T20:31:02.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f8b700029a0 con 0x7f8b780a7290 2020-07-16T20:31:02.629 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 msgr2=0x7f8b7812f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b7812f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 >> v2:172.21.15.41:3300/0 conn(0x7f8b7812cad0 msgr2=0x7f8b7812ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> v2:172.21.15.41:3300/0 conn(0x7f8b7812cad0 0x7f8b7812ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 >> v1:172.21.15.157:6789/0 conn(0x7f8b780a7290 legacy=0x7f8b780615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b54003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.631 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b54003d10 0x7f8b540044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b540049d0 0x7f8b54004e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78061cd0 con 0x7f8b54003d10 2020-07-16T20:31:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7812d3c0 con 0x7f8b540049d0 2020-07-16T20:31:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54004280 con 0x7f8b78132f40 2020-07-16T20:31:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b540049d0 0x7f8b54004e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b767fc700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b54003d10 0x7f8b540044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b76ffd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b54003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 -- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 msgr2=0x7f8b54003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8b78132f40 0x7f8b54003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 -- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b54003d10 msgr2=0x7f8b540044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b54003d10 0x7f8b540044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b781389d0 con 0x7f8b540049d0 2020-07-16T20:31:02.635 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b78138c70 con 0x7f8b540049d0 2020-07-16T20:31:02.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7812f250 con 0x7f8b540049d0 2020-07-16T20:31:02.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.610+0000 7f8b777fe700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b540049d0 0x7f8b54004e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f8b6800d000 tx=0x7f8b68008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.636 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.611+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b68017070 con 0x7f8b540049d0 2020-07-16T20:31:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.611+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6800c040 con 0x7f8b540049d0 2020-07-16T20:31:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.611+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b6800da20 con 0x7f8b540049d0 2020-07-16T20:31:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.611+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7812f590 con 0x7f8b540049d0 2020-07-16T20:31:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.612+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8b6800db80 con 0x7f8b540049d0 2020-07-16T20:31:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.612+0000 7f8b5effd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8b5405c640 0x7f8b5405eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.612+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8b680680a0 con 0x7f8b540049d0 2020-07-16T20:31:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.612+0000 7f8b76ffd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8b5405c640 0x7f8b5405eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.612+0000 7f8b76ffd700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8b5405c640 0x7f8b5405eb00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8b7000d000 tx=0x7f8b70009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.615+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f8b680407b0 con 0x7f8b540049d0 2020-07-16T20:31:02.768 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.766+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b78057490 con 0x7f8b540049d0 2020-07-16T20:31:02.769 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.767+0000 7f8b5effd700 1 -- 172.21.15.157:0/1307085405 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f8b68043dd0 con 0x7f8b540049d0 2020-07-16T20:31:02.769 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:02.769 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:31:02.770 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.768+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8b5405c640 msgr2=0x7f8b5405eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.768+0000 7f8b77fff700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8b5405c640 0x7f8b5405eb00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8b7000d000 tx=0x7f8b70009040).stop 2020-07-16T20:31:02.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.768+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b540049d0 msgr2=0x7f8b54004e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.768+0000 7f8b77fff700 1 --2- 172.21.15.157:0/1307085405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b540049d0 0x7f8b54004e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f8b6800d000 tx=0x7f8b68008040).stop 2020-07-16T20:31:02.771 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.768+0000 7f8b777fe700 1 -- 172.21.15.157:0/1307085405 reap_dead start 2020-07-16T20:31:02.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.769+0000 7f8b777fe700 1 -- 172.21.15.157:0/1307085405 reap_dead start 2020-07-16T20:31:02.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.769+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 shutdown_connections 2020-07-16T20:31:02.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.769+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 >> 172.21.15.157:0/1307085405 conn(0x7f8b7805b810 msgr2=0x7f8b7805f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.769+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 shutdown_connections 2020-07-16T20:31:02.772 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.769+0000 7f8b77fff700 1 -- 172.21.15.157:0/1307085405 wait complete. 2020-07-16T20:31:02.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:32.588806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:42.750526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:46.151313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:48.751540+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:31:02.782 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:31:02.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 Processor -- start 2020-07-16T20:31:02.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 -- start start 2020-07-16T20:31:02.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f33240a7470 0x7f3324133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3324133cc0 con 0x7f33240a8a20 2020-07-16T20:31:02.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33240a4710 con 0x7f3324133860 2020-07-16T20:31:02.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.890+0000 7f3328fd8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33240a5c00 con 0x7f33240a7470 2020-07-16T20:31:02.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f33240a7470 0x7f3324133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3321d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3324133860 0x7f33240a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36906/0 (socket says 172.21.15.157:36906) 2020-07-16T20:31:02.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3321d9b700 1 -- 172.21.15.157:0/2522505403 learned_addr learned my addr 172.21.15.157:0/2522505403 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332259c700 1 -- 172.21.15.157:0/2522505403 >> v1:172.21.15.157:6789/0 conn(0x7f3324133860 legacy=0x7f33240a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332259c700 1 -- 172.21.15.157:0/2522505403 >> v1:172.21.15.41:6789/0 conn(0x7f33240a8a20 legacy=0x7f3324140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332259c700 1 -- 172.21.15.157:0/2522505403 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240a9110 con 0x7f33240a7470 2020-07-16T20:31:02.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332159a700 1 -- 172.21.15.157:0/2522505403 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958686899 0 0) 0x7f33240a4710 con 0x7f3324133860 2020-07-16T20:31:02.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332259c700 1 --2- 172.21.15.157:0/2522505403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33240a7470 0x7f3324133370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f331c0032b0 tx=0x7f331c0091d0).ready entity=mon.1 client_cookie=e93b1a03a96910e2 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332159a700 1 -- 172.21.15.157:0/2522505403 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c00ba50 con 0x7f33240a7470 2020-07-16T20:31:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332159a700 1 -- 172.21.15.157:0/2522505403 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c00bbb0 con 0x7f33240a7470 2020-07-16T20:31:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f332159a700 1 -- 172.21.15.157:0/2522505403 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f331c00bd20 con 0x7f33240a7470 2020-07-16T20:31:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 -- 172.21.15.157:0/2522505403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33240a7470 msgr2=0x7f3324133370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.902 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2522505403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33240a7470 0x7f3324133370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f331c0032b0 tx=0x7f331c0091d0).stop 2020-07-16T20:31:02.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 -- 172.21.15.157:0/2522505403 shutdown_connections 2020-07-16T20:31:02.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2522505403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33240a7470 0x7f3324133370 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:02.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 -- 172.21.15.157:0/2522505403 >> 172.21.15.157:0/2522505403 conn(0x7f332409e7e0 msgr2=0x7f332409ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:02.903 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 -- 172.21.15.157:0/2522505403 shutdown_connections 2020-07-16T20:31:02.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.891+0000 7f3328fd8700 1 -- 172.21.15.157:0/2522505403 wait complete. 2020-07-16T20:31:02.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 Processor -- start 2020-07-16T20:31:02.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 -- start start 2020-07-16T20:31:02.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3324129110 0x7f3324136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.904 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3324134820 con 0x7f3324133860 2020-07-16T20:31:02.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3324134e00 con 0x7f33240a8a20 2020-07-16T20:31:02.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3328fd8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3324133f90 con 0x7f3324129110 2020-07-16T20:31:02.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f332259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f33240a8a20 0x7f3324134110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36910/0 (socket says 172.21.15.157:36910) 2020-07-16T20:31:02.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f332259c700 1 -- 172.21.15.157:0/2612357846 learned_addr learned my addr 172.21.15.157:0/2612357846 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:02.905 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.893+0000 7f3322d9d700 1 --2- 172.21.15.157:0/2612357846 >> v2:172.21.15.157:3300/0 conn(0x7f3324129110 0x7f3324136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670045469 0 0) 0x7f3324134e00 con 0x7f33240a8a20 2020-07-16T20:31:02.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3300003240 con 0x7f33240a8a20 2020-07-16T20:31:02.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3322d9d700 1 -- 172.21.15.157:0/2612357846 >> v1:172.21.15.157:6789/0 conn(0x7f33240a8a20 legacy=0x7f3324134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3322d9d700 1 -- 172.21.15.157:0/2612357846 >> v1:172.21.15.41:6789/0 conn(0x7f3324133860 legacy=0x7f3324128a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:02.906 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3322d9d700 1 -- 172.21.15.157:0/2612357846 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240ac390 con 0x7f3324129110 2020-07-16T20:31:02.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3322d9d700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3324129110 0x7f3324136c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f332406bb00 tx=0x7f330c007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f330c013410 con 0x7f3324129110 2020-07-16T20:31:02.907 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c013570 con 0x7f3324129110 2020-07-16T20:31:02.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3324135090 con 0x7f3324129110 2020-07-16T20:31:02.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f330c0138d0 con 0x7f3324129110 2020-07-16T20:31:02.908 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.894+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33240abeb0 con 0x7f3324129110 2020-07-16T20:31:02.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.895+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3324135220 con 0x7f3324129110 2020-07-16T20:31:02.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.895+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f330c010030 con 0x7f3324129110 2020-07-16T20:31:02.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.895+0000 7f331a7fc700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 0x7f33000527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:02.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.895+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f330c067830 con 0x7f3324129110 2020-07-16T20:31:02.909 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.895+0000 7f332259c700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 0x7f33000527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:02.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.896+0000 7f332259c700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 0x7f33000527f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f331c006ca0 tx=0x7f331c016000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:02.910 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:02.900+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f330c03ffc0 con 0x7f3324129110 2020-07-16T20:31:03.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.045+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3324133cc0 con 0x7f3324129110 2020-07-16T20:31:03.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.045+0000 7f331a7fc700 1 -- 172.21.15.157:0/2612357846 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3324133cc0 con 0x7f3324129110 2020-07-16T20:31:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2020-07-16T20:31:03.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 msgr2=0x7f33000527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 0x7f33000527f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f331c006ca0 tx=0x7f331c016000).stop 2020-07-16T20:31:03.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3324129110 msgr2=0x7f3324136c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3324129110 0x7f3324136c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f332406bb00 tx=0x7f330c007a80).stop 2020-07-16T20:31:03.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 shutdown_connections 2020-07-16T20:31:03.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f3300050330 0x7f33000527f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 --2- 172.21.15.157:0/2612357846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3324129110 0x7f3324136c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 >> 172.21.15.157:0/2612357846 conn(0x7f332409e7e0 msgr2=0x7f332409ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 shutdown_connections 2020-07-16T20:31:03.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.048+0000 7f3328fd8700 1 -- 172.21.15.157:0/2612357846 wait complete. 2020-07-16T20:31:03.059 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:31:03.169 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.169+0000 7f9b42130700 1 Processor -- start 2020-07-16T20:31:03.170 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.169+0000 7f9b42130700 1 -- start start 2020-07-16T20:31:03.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9b3c0a7470 0x7f9b3c133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 0x7f9b3c140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c133cc0 con 0x7f9b3c133860 2020-07-16T20:31:03.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0a4710 con 0x7f9b3c0a7470 2020-07-16T20:31:03.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0a5c00 con 0x7f9b3c0a8a20 2020-07-16T20:31:03.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9b3c0a7470 0x7f9b3c133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9b3c133860 0x7f9b3c0a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36918/0 (socket says 172.21.15.157:36918) 2020-07-16T20:31:03.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3affd700 1 -- 172.21.15.157:0/4239788166 learned_addr learned my addr 172.21.15.157:0/4239788166 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:03.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/4239788166 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 msgr2=0x7f9b3c140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:03.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3bfff700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 0x7f9b3c140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 0x7f9b3c140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/4239788166 >> v1:172.21.15.157:6789/0 conn(0x7f9b3c133860 legacy=0x7f9b3c0a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3a7fc700 1 -- 172.21.15.157:0/4239788166 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509080707 0 0) 0x7f9b300010d0 con 0x7f9b3c133860 2020-07-16T20:31:03.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/4239788166 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0a9110 con 0x7f9b3c0a7470 2020-07-16T20:31:03.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3bfff700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 0x7f9b3c140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:03.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b3c0a7470 0x7f9b3c133370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9b2c002f30 tx=0x7f9b2c006dd0).ready entity=mon.1 client_cookie=b6db33b706d8f13 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3a7fc700 1 -- 172.21.15.157:0/4239788166 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c0097f0 con 0x7f9b3c0a7470 2020-07-16T20:31:03.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3a7fc700 1 -- 172.21.15.157:0/4239788166 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c009950 con 0x7f9b3c0a7470 2020-07-16T20:31:03.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b3a7fc700 1 -- 172.21.15.157:0/4239788166 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c009cb0 con 0x7f9b3c0a7470 2020-07-16T20:31:03.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 -- 172.21.15.157:0/4239788166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b3c0a7470 msgr2=0x7f9b3c133370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.170+0000 7f9b42130700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b3c0a7470 0x7f9b3c133370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9b2c002f30 tx=0x7f9b2c006dd0).stop 2020-07-16T20:31:03.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 -- 172.21.15.157:0/4239788166 shutdown_connections 2020-07-16T20:31:03.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b3c0a8a20 0x7f9b3c140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 --2- 172.21.15.157:0/4239788166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b3c0a7470 0x7f9b3c133370 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 -- 172.21.15.157:0/4239788166 >> 172.21.15.157:0/4239788166 conn(0x7f9b3c09e7e0 msgr2=0x7f9b3c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 -- 172.21.15.157:0/4239788166 shutdown_connections 2020-07-16T20:31:03.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.171+0000 7f9b42130700 1 -- 172.21.15.157:0/4239788166 wait complete. 2020-07-16T20:31:03.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.172+0000 7f9b42130700 1 Processor -- start 2020-07-16T20:31:03.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.172+0000 7f9b42130700 1 -- start start 2020-07-16T20:31:03.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b42130700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9b3c0a8a20 0x7f9b3c0abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b42130700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c137be0 con 0x7f9b3c133860 2020-07-16T20:31:03.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b42130700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c137670 con 0x7f9b3c139320 2020-07-16T20:31:03.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b42130700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c1379d0 con 0x7f9b3c0a8a20 2020-07-16T20:31:03.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3bfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9b3c139320 0x7f9b3c129a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36928/0 (socket says 172.21.15.157:36928) 2020-07-16T20:31:03.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3bfff700 1 -- 172.21.15.157:0/2189189235 learned_addr learned my addr 172.21.15.157:0/2189189235 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:03.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/2189189235 >> v2:172.21.15.41:3300/0 conn(0x7f9b3c0a8a20 0x7f9b3c0abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038675264 0 0) 0x7f9b3c137670 con 0x7f9b3c139320 2020-07-16T20:31:03.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b14003240 con 0x7f9b3c139320 2020-07-16T20:31:03.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323925905 0 0) 0x7f9b3c137be0 con 0x7f9b3c133860 2020-07-16T20:31:03.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b3c137670 con 0x7f9b3c133860 2020-07-16T20:31:03.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2598490354 0 0) 0x7f9b14003240 con 0x7f9b3c139320 2020-07-16T20:31:03.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9b3c137be0 con 0x7f9b3c139320 2020-07-16T20:31:03.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f9b34001810 con 0x7f9b3c139320 2020-07-16T20:31:03.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 >> v2:172.21.15.41:3300/0 conn(0x7f9b3c0a8a20 msgr2=0x7f9b3c0abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 --2- 172.21.15.157:0/2189189235 >> v2:172.21.15.41:3300/0 conn(0x7f9b3c0a8a20 0x7f9b3c0abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 >> v1:172.21.15.157:6789/0 conn(0x7f9b3c139320 legacy=0x7f9b3c129a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 >> v1:172.21.15.41:6789/0 conn(0x7f9b3c133860 legacy=0x7f9b3c139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 0x7f9b14003d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b140044e0 0x7f9b14004940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b14004e30 0x7f9b1400b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c1379d0 con 0x7f9b14004e30 2020-07-16T20:31:03.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400bc20 con 0x7f9b14003970 2020-07-16T20:31:03.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1400bd60 con 0x7f9b140044e0 2020-07-16T20:31:03.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 0x7f9b14003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3bfff700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b14004e30 0x7f9b1400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.173+0000 7f9b3affd700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b140044e0 0x7f9b14004940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b140044e0 msgr2=0x7f9b14004940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f9b140044e0 0x7f9b14004940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b14004e30 msgr2=0x7f9b1400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b14004e30 0x7f9b1400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c137e80 con 0x7f9b14003970 2020-07-16T20:31:03.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c135e80 con 0x7f9b14003970 2020-07-16T20:31:03.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3bfff700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b14004e30 0x7f9b1400b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:03.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3bfff700 1 -- 172.21.15.157:0/2189189235 reap_dead start 2020-07-16T20:31:03.191 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c12a340 con 0x7f9b14003970 2020-07-16T20:31:03.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b3b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 0x7f9b14003d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9b2c01c000 tx=0x7f9b2c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c01e6e0 con 0x7f9b14003970 2020-07-16T20:31:03.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c023070 con 0x7f9b14003970 2020-07-16T20:31:03.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.174+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c01ea30 con 0x7f9b14003970 2020-07-16T20:31:03.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c136010 con 0x7f9b14003970 2020-07-16T20:31:03.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f9b2c02f070 con 0x7f9b14003970 2020-07-16T20:31:03.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b1b7fe700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 0x7f9b140562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9b2c06a140 con 0x7f9b14003970 2020-07-16T20:31:03.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b3affd700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 0x7f9b140562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.175+0000 7f9b3affd700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 0x7f9b140562f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9b3000b000 tx=0x7f9b30009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.178+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f9b2c046280 con 0x7f9b14003970 2020-07-16T20:31:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.326+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9b3c057490 con 0x7f9b14003970 2020-07-16T20:31:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.326+0000 7f9b1b7fe700 1 -- 172.21.15.157:0/2189189235 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9b2c045e70 con 0x7f9b14003970 2020-07-16T20:31:03.328 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 msgr2=0x7f9b140562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 0x7f9b140562f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9b3000b000 tx=0x7f9b30009040).stop 2020-07-16T20:31:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 msgr2=0x7f9b14003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 0x7f9b14003d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9b2c01c000 tx=0x7f9b2c015000).stop 2020-07-16T20:31:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 shutdown_connections 2020-07-16T20:31:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f9b14053e30 0x7f9b140562f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 --2- 172.21.15.157:0/2189189235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b14003970 0x7f9b14003d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 >> 172.21.15.157:0/2189189235 conn(0x7f9b3c09e7e0 msgr2=0x7f9b3c09ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 shutdown_connections 2020-07-16T20:31:03.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.328+0000 7f9b42130700 1 -- 172.21.15.157:0/2189189235 wait complete. 2020-07-16T20:31:03.338 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:31:03.448 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.447+0000 7f6f61f5f700 1 Processor -- start 2020-07-16T20:31:03.448 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 -- start start 2020-07-16T20:31:03.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f5c137590 0x7f6f5c1379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6f5c137ee0 0x7f6f5c141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0ad400 con 0x7f6f5c09e7e0 2020-07-16T20:31:03.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0624c0 con 0x7f6f5c137ee0 2020-07-16T20:31:03.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f61f5f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a6480 con 0x7f6f5c137590 2020-07-16T20:31:03.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f5bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f5c137590 0x7f6f5c1379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f60f5d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6f5c09e7e0 0x7f6f5c0a7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36938/0 (socket says 172.21.15.157:36938) 2020-07-16T20:31:03.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.448+0000 7f6f60f5d700 1 -- 172.21.15.157:0/2623528284 learned_addr learned my addr 172.21.15.157:0/2623528284 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:03.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5bfff700 1 -- 172.21.15.157:0/2623528284 >> v2:172.21.15.41:3300/0 conn(0x7f6f5c137ee0 msgr2=0x7f6f5c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:03.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f6175e700 1 --2- 172.21.15.157:0/2623528284 >> v2:172.21.15.41:3300/0 conn(0x7f6f5c137ee0 0x7f6f5c141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5bfff700 1 --2- 172.21.15.157:0/2623528284 >> v2:172.21.15.41:3300/0 conn(0x7f6f5c137ee0 0x7f6f5c141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5b7fe700 1 -- 172.21.15.157:0/2623528284 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281382412 0 0) 0x7f6f5c0ad400 con 0x7f6f5c09e7e0 2020-07-16T20:31:03.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5bfff700 1 -- 172.21.15.157:0/2623528284 >> v1:172.21.15.157:6789/0 conn(0x7f6f5c09e7e0 legacy=0x7f6f5c0a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5bfff700 1 -- 172.21.15.157:0/2623528284 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0a6720 con 0x7f6f5c137590 2020-07-16T20:31:03.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5bfff700 1 --2- 172.21.15.157:0/2623528284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c137590 0x7f6f5c1379f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f6f50002f30 tx=0x7f6f50006dd0).ready entity=mon.1 client_cookie=c18407f98042519c server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5b7fe700 1 -- 172.21.15.157:0/2623528284 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f500097f0 con 0x7f6f5c137590 2020-07-16T20:31:03.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5b7fe700 1 -- 172.21.15.157:0/2623528284 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50009950 con 0x7f6f5c137590 2020-07-16T20:31:03.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f5b7fe700 1 -- 172.21.15.157:0/2623528284 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f50009cb0 con 0x7f6f5c137590 2020-07-16T20:31:03.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 -- 172.21.15.157:0/2623528284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c137590 msgr2=0x7f6f5c1379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/2623528284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c137590 0x7f6f5c1379f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f6f50002f30 tx=0x7f6f50006dd0).stop 2020-07-16T20:31:03.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 -- 172.21.15.157:0/2623528284 shutdown_connections 2020-07-16T20:31:03.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/2623528284 >> v2:172.21.15.41:3300/0 conn(0x7f6f5c137ee0 0x7f6f5c141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/2623528284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c137590 0x7f6f5c1379f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 -- 172.21.15.157:0/2623528284 >> 172.21.15.157:0/2623528284 conn(0x7f6f5c05d3f0 msgr2=0x7f6f5c0ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 -- 172.21.15.157:0/2623528284 shutdown_connections 2020-07-16T20:31:03.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.449+0000 7f6f61f5f700 1 -- 172.21.15.157:0/2623528284 wait complete. 2020-07-16T20:31:03.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.450+0000 7f6f61f5f700 1 Processor -- start 2020-07-16T20:31:03.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.450+0000 7f6f61f5f700 1 -- start start 2020-07-16T20:31:03.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f61f5f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f5c147800 0x7f6f5c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f61f5f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c13b8d0 con 0x7f6f5c137ee0 2020-07-16T20:31:03.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f61f5f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0a0620 con 0x7f6f5c09e7e0 2020-07-16T20:31:03.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f61f5f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c13b6c0 con 0x7f6f5c147800 2020-07-16T20:31:03.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f60f5d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6f5c09e7e0 0x7f6f5c066da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36946/0 (socket says 172.21.15.157:36946) 2020-07-16T20:31:03.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f6175e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f5c147800 0x7f6f5c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f60f5d700 1 -- 172.21.15.157:0/113358511 learned_addr learned my addr 172.21.15.157:0/113358511 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:03.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f6175e700 1 -- 172.21.15.157:0/113358511 >> v1:172.21.15.157:6789/0 conn(0x7f6f5c09e7e0 legacy=0x7f6f5c066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f6175e700 1 -- 172.21.15.157:0/113358511 >> v1:172.21.15.41:6789/0 conn(0x7f6f5c137ee0 legacy=0x7f6f5c0a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914935378 0 0) 0x7f6f5c0a0620 con 0x7f6f5c09e7e0 2020-07-16T20:31:03.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.451+0000 7f6f6175e700 1 -- 172.21.15.157:0/113358511 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0a08c0 con 0x7f6f5c147800 2020-07-16T20:31:03.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f6175e700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c147800 0x7f6f5c146d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6f5c0a1f00 tx=0x7f6f54008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.462 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f540077e0 con 0x7f6f5c147800 2020-07-16T20:31:03.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54007940 con 0x7f6f5c147800 2020-07-16T20:31:03.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0a20d0 con 0x7f6f5c147800 2020-07-16T20:31:03.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f54007ca0 con 0x7f6f5c147800 2020-07-16T20:31:03.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.452+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0a1470 con 0x7f6f5c147800 2020-07-16T20:31:03.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0a16f0 con 0x7f6f5c147800 2020-07-16T20:31:03.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6f5401b460 con 0x7f6f5c147800 2020-07-16T20:31:03.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f58ff9700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 0x7f6f34052400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6f54068080 con 0x7f6f5c147800 2020-07-16T20:31:03.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f60f5d700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 0x7f6f34052400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.453+0000 7f6f60f5d700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 0x7f6f34052400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6f4c007650 tx=0x7f6f4c0078e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.456+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6f54040710 con 0x7f6f5c147800 2020-07-16T20:31:03.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.604+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f5c057490 con 0x7f6f5c147800 2020-07-16T20:31:03.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.605+0000 7f6f58ff9700 1 -- 172.21.15.157:0/113358511 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6f54043d30 con 0x7f6f5c147800 2020-07-16T20:31:03.605 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:03.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 msgr2=0x7f6f34052400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 0x7f6f34052400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6f4c007650 tx=0x7f6f4c0078e0).stop 2020-07-16T20:31:03.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c147800 msgr2=0x7f6f5c146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c147800 0x7f6f5c146d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f6f5c0a1f00 tx=0x7f6f54008040).stop 2020-07-16T20:31:03.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 shutdown_connections 2020-07-16T20:31:03.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f3404ff40 0x7f6f34052400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 --2- 172.21.15.157:0/113358511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f5c147800 0x7f6f5c146d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 >> 172.21.15.157:0/113358511 conn(0x7f6f5c05d3f0 msgr2=0x7f6f5c09f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 shutdown_connections 2020-07-16T20:31:03.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.606+0000 7f6f61f5f700 1 -- 172.21.15.157:0/113358511 wait complete. 2020-07-16T20:31:03.617 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:31:03.726 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.726+0000 7f42f05f7700 1 Processor -- start 2020-07-16T20:31:03.727 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.726+0000 7f42f05f7700 1 -- start start 2020-07-16T20:31:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42e80a7470 0x7f42e8133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e8133cc0 con 0x7f42e80a8a20 2020-07-16T20:31:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80a4710 con 0x7f42e8133860 2020-07-16T20:31:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e80a5c00 con 0x7f42e80a7470 2020-07-16T20:31:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ee393700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42e80a7470 0x7f42e8133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42edb92700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f42e8133860 0x7f42e80a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36952/0 (socket says 172.21.15.157:36952) 2020-07-16T20:31:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42edb92700 1 -- 172.21.15.157:0/1723724937 learned_addr learned my addr 172.21.15.157:0/1723724937 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ee393700 1 -- 172.21.15.157:0/1723724937 >> v1:172.21.15.157:6789/0 conn(0x7f42e8133860 legacy=0x7f42e80a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ee393700 1 -- 172.21.15.157:0/1723724937 >> v1:172.21.15.41:6789/0 conn(0x7f42e80a8a20 legacy=0x7f42e8140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ee393700 1 -- 172.21.15.157:0/1723724937 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80a9110 con 0x7f42e80a7470 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ee393700 1 --2- 172.21.15.157:0/1723724937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e80a7470 0x7f42e8133370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f42d8002f30 tx=0x7f42d8006dd0).ready entity=mon.1 client_cookie=7409cac00d969ac5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ed391700 1 -- 172.21.15.157:0/1723724937 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d80097f0 con 0x7f42e80a7470 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ed391700 1 -- 172.21.15.157:0/1723724937 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8009950 con 0x7f42e80a7470 2020-07-16T20:31:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42ed391700 1 -- 172.21.15.157:0/1723724937 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d8009cb0 con 0x7f42e80a7470 2020-07-16T20:31:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 -- 172.21.15.157:0/1723724937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e80a7470 msgr2=0x7f42e8133370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.727+0000 7f42f05f7700 1 --2- 172.21.15.157:0/1723724937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e80a7470 0x7f42e8133370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f42d8002f30 tx=0x7f42d8006dd0).stop 2020-07-16T20:31:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.728+0000 7f42f05f7700 1 -- 172.21.15.157:0/1723724937 shutdown_connections 2020-07-16T20:31:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.728+0000 7f42f05f7700 1 --2- 172.21.15.157:0/1723724937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e80a7470 0x7f42e8133370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.728+0000 7f42f05f7700 1 -- 172.21.15.157:0/1723724937 >> 172.21.15.157:0/1723724937 conn(0x7f42e809e7e0 msgr2=0x7f42e809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.728+0000 7f42f05f7700 1 -- 172.21.15.157:0/1723724937 shutdown_connections 2020-07-16T20:31:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.728+0000 7f42f05f7700 1 -- 172.21.15.157:0/1723724937 wait complete. 2020-07-16T20:31:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 Processor -- start 2020-07-16T20:31:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 -- start start 2020-07-16T20:31:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 0x7f42e80abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 0x7f42e8129ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42e8136ea0 0x7f42e8129fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e81355d0 con 0x7f42e8133860 2020-07-16T20:31:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e8135870 con 0x7f42e8136ea0 2020-07-16T20:31:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.729+0000 7f42f05f7700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e813a3d0 con 0x7f42e80a8a20 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42e8136ea0 0x7f42e8129fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f42e8136ea0 0x7f42e8129fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34274/0 (socket says 172.21.15.157:34274) 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 -- 172.21.15.157:0/2428121941 learned_addr learned my addr 172.21.15.157:0/2428121941 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42edb92700 1 --2- 172.21.15.157:0/2428121941 >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 0x7f42e8129ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42ee393700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 0x7f42e80abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 -- 172.21.15.157:0/2428121941 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 msgr2=0x7f42e80abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 0x7f42e80abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 -- 172.21.15.157:0/2428121941 >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 msgr2=0x7f42e8129ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 --2- 172.21.15.157:0/2428121941 >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 0x7f42e8129ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 -- 172.21.15.157:0/2428121941 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e813a540 con 0x7f42e8136ea0 2020-07-16T20:31:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42edb92700 1 --2- 172.21.15.157:0/2428121941 >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 0x7f42e8129ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42ee393700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 0x7f42e80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42eeb94700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e8136ea0 0x7f42e8129fd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f42e806bb00 tx=0x7f42e0007e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e000a7b0 con 0x7f42e8136ea0 2020-07-16T20:31:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e000a910 con 0x7f42e8136ea0 2020-07-16T20:31:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e809f610 con 0x7f42e8136ea0 2020-07-16T20:31:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e000ac70 con 0x7f42e8136ea0 2020-07-16T20:31:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.730+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e81345e0 con 0x7f42e8136ea0 2020-07-16T20:31:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.731+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e8057490 con 0x7f42e8136ea0 2020-07-16T20:31:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.731+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f42e0019030 con 0x7f42e8136ea0 2020-07-16T20:31:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.732+0000 7f42d67fc700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 0x7f42c0052400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.732+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f42e0067450 con 0x7f42e8136ea0 2020-07-16T20:31:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.732+0000 7f42ee393700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 0x7f42c0052400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.732+0000 7f42ee393700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 0x7f42c0052400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42d801a000 tx=0x7f42d8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.735+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f42e003fbe0 con 0x7f42e8136ea0 2020-07-16T20:31:03.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.882+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42e8133cc0 con 0x7f42e8136ea0 2020-07-16T20:31:03.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.883+0000 7f42d67fc700 1 -- 172.21.15.157:0/2428121941 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f42e8133cc0 con 0x7f42e8136ea0 2020-07-16T20:31:03.884 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:03.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 msgr2=0x7f42c0052400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 0x7f42c0052400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42d801a000 tx=0x7f42d8015000).stop 2020-07-16T20:31:03.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e8136ea0 msgr2=0x7f42e8129fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:03.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e8136ea0 0x7f42e8129fd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f42e806bb00 tx=0x7f42e0007e90).stop 2020-07-16T20:31:03.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 shutdown_connections 2020-07-16T20:31:03.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f42c004ff40 0x7f42c0052400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f42e80a8a20 0x7f42e80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42e8136ea0 0x7f42e8129fd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 --2- 172.21.15.157:0/2428121941 >> v2:172.21.15.41:3300/0 conn(0x7f42e8133860 0x7f42e8129ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:03.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 >> 172.21.15.157:0/2428121941 conn(0x7f42e809e7e0 msgr2=0x7f42e809ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:03.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 shutdown_connections 2020-07-16T20:31:03.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:03.884+0000 7f42f05f7700 1 -- 172.21.15.157:0/2428121941 wait complete. 2020-07-16T20:31:03.895 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:31:04.002 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 Processor -- start 2020-07-16T20:31:04.002 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 -- start start 2020-07-16T20:31:04.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f077c136ac0 0x7f077c144c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0aba80 con 0x7f077c05c1c0 2020-07-16T20:31:04.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0abd20 con 0x7f077c0ab5e0 2020-07-16T20:31:04.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.002+0000 7f07826b0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0acad0 con 0x7f077c136ac0 2020-07-16T20:31:04.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f0781eaf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f077c136ac0 0x7f077c144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07816ae700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f077c0ab5e0 0x7f077c05bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36966/0 (socket says 172.21.15.157:36966) 2020-07-16T20:31:04.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07816ae700 1 -- 172.21.15.157:0/3186583944 learned_addr learned my addr 172.21.15.157:0/3186583944 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:04.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f0781eaf700 1 -- 172.21.15.157:0/3186583944 >> v1:172.21.15.157:6789/0 conn(0x7f077c0ab5e0 legacy=0x7f077c05bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.013 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f0781eaf700 1 -- 172.21.15.157:0/3186583944 >> v1:172.21.15.41:6789/0 conn(0x7f077c05c1c0 legacy=0x7f077c1363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f076bfff700 1 -- 172.21.15.157:0/3186583944 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406065166 0 0) 0x7f077c0abd20 con 0x7f077c0ab5e0 2020-07-16T20:31:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f0781eaf700 1 -- 172.21.15.157:0/3186583944 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0abfc0 con 0x7f077c136ac0 2020-07-16T20:31:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f0781eaf700 1 --2- 172.21.15.157:0/3186583944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077c136ac0 0x7f077c144c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f077c05d440 tx=0x7f07740091d0).ready entity=mon.1 client_cookie=8c0420f6961205eb server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f076bfff700 1 -- 172.21.15.157:0/3186583944 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774009e80 con 0x7f077c136ac0 2020-07-16T20:31:04.014 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f076bfff700 1 -- 172.21.15.157:0/3186583944 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400bb80 con 0x7f077c136ac0 2020-07-16T20:31:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f076bfff700 1 -- 172.21.15.157:0/3186583944 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077400bcf0 con 0x7f077c136ac0 2020-07-16T20:31:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 -- 172.21.15.157:0/3186583944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077c136ac0 msgr2=0x7f077c144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 --2- 172.21.15.157:0/3186583944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077c136ac0 0x7f077c144c30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f077c05d440 tx=0x7f07740091d0).stop 2020-07-16T20:31:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 -- 172.21.15.157:0/3186583944 shutdown_connections 2020-07-16T20:31:04.015 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 --2- 172.21.15.157:0/3186583944 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077c136ac0 0x7f077c144c30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 -- 172.21.15.157:0/3186583944 >> 172.21.15.157:0/3186583944 conn(0x7f077c066630 msgr2=0x7f077c066a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:04.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 -- 172.21.15.157:0/3186583944 shutdown_connections 2020-07-16T20:31:04.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.003+0000 7f07826b0700 1 -- 172.21.15.157:0/3186583944 wait complete. 2020-07-16T20:31:04.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 Processor -- start 2020-07-16T20:31:04.016 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 -- start start 2020-07-16T20:31:04.017 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f077c05c1c0 0x7f077c0a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.017 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 0x7f077c12bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.017 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c137060 con 0x7f077c0ab5e0 2020-07-16T20:31:04.017 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c137300 con 0x7f077c05c1c0 2020-07-16T20:31:04.017 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.005+0000 7f07826b0700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1375a0 con 0x7f077c139df0 2020-07-16T20:31:04.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f07816ae700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f077c05c1c0 0x7f077c0a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 0x7f077c12bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0780ead700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f077c0ab5e0 0x7f077c1396e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50550/0 (socket says 172.21.15.157:50550) 2020-07-16T20:31:04.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0780ead700 1 -- 172.21.15.157:0/850363110 learned_addr learned my addr 172.21.15.157:0/850363110 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:04.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 -- 172.21.15.157:0/850363110 >> v2:172.21.15.41:3300/0 conn(0x7f077c05c1c0 msgr2=0x7f077c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.019 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 --2- 172.21.15.157:0/850363110 >> v2:172.21.15.41:3300/0 conn(0x7f077c05c1c0 0x7f077c0a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.019 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 -- 172.21.15.157:0/850363110 >> v1:172.21.15.41:6789/0 conn(0x7f077c0ab5e0 legacy=0x7f077c1396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.019 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 -- 172.21.15.157:0/850363110 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c132d20 con 0x7f077c139df0 2020-07-16T20:31:04.019 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f0781eaf700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 0x7f077c12bc00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f077c05d440 tx=0x7f0774016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.019 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07740107a0 con 0x7f077c139df0 2020-07-16T20:31:04.020 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774010900 con 0x7f077c139df0 2020-07-16T20:31:04.020 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c1327b0 con 0x7f077c139df0 2020-07-16T20:31:04.020 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.006+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774010c60 con 0x7f077c139df0 2020-07-16T20:31:04.020 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.007+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c1392a0 con 0x7f077c139df0 2020-07-16T20:31:04.020 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.007+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c1329a0 con 0x7f077c139df0 2020-07-16T20:31:04.021 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.008+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0774027030 con 0x7f077c139df0 2020-07-16T20:31:04.021 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.008+0000 7f07697fa700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 0x7f07580523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.021 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.008+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f07740690f0 con 0x7f077c139df0 2020-07-16T20:31:04.021 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.008+0000 7f07816ae700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 0x7f07580523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.021 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.008+0000 7f07816ae700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 0x7f07580523f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f076c00d000 tx=0x7f076c0079e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.022 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.012+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f077c1329a0 con 0x7f077c139df0 2020-07-16T20:31:04.208 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.208+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f077c1329a0 con 0x7f077c139df0 2020-07-16T20:31:04.209 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.209+0000 7f07697fa700 1 -- 172.21.15.157:0/850363110 <== mon.2 v2:172.21.15.41:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2133 (secure 0 0 0) 0x7f077c1329a0 con 0x7f077c139df0 2020-07-16T20:31:04.210 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:04.210 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3123870471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3123870471},{"type":"v1","addr":"172.21.15.41:6833","nonce":3123870471}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:51.081808+0000","modified":"2020-07-16T20:30:54.743225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.157:6835/3430841144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3430841144},{"type":"v1","addr":"172.21.15.157:6835","nonce":3430841144}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:31:04.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 msgr2=0x7f07580523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 0x7f07580523f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f076c00d000 tx=0x7f076c0079e0).stop 2020-07-16T20:31:04.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 msgr2=0x7f077c12bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 0x7f077c12bc00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f077c05d440 tx=0x7f0774016000).stop 2020-07-16T20:31:04.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 shutdown_connections 2020-07-16T20:31:04.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f075804ff30 0x7f07580523f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 --2- 172.21.15.157:0/850363110 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f077c139df0 0x7f077c12bc00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 --2- 172.21.15.157:0/850363110 >> v2:172.21.15.41:3300/0 conn(0x7f077c05c1c0 0x7f077c0a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 >> 172.21.15.157:0/850363110 conn(0x7f077c066630 msgr2=0x7f077c133f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:04.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 shutdown_connections 2020-07-16T20:31:04.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.210+0000 7f07826b0700 1 -- 172.21.15.157:0/850363110 wait complete. 2020-07-16T20:31:04.215 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 6 2020-07-16T20:31:04.423 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-16T20:30:51.081808+0000', 'modified': '2020-07-16T20:30:54.743225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4384}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4384': {'gid': 4384, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.157:6835/3430841144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 3430841144}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 3430841144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-16T20:31:04.424 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-16T20:31:04.425 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-07-16T20:31:04.553 INFO:teuthology.orchestra.run.smithi157.stdout:{"cluster_fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","whoami":0,"id":4384,"want_state":"up:active","state":"up:active","rank_uptime":10.800352032999999,"mdsmap_epoch":6,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":11.101648961} 2020-07-16T20:31:04.554 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "cfd2f8dd-09bb-4e6b-8709-0ded1adfce51", "id": 4384, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 10.800352033, "state": "up:active", "uptime": 11.101648961, "want_state": "up:active", "whoami": 0 } 2020-07-16T20:31:04.555 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-07-16T20:31:04.591 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-07-16T20:31:04.592 INFO:tasks.ceph_fuse:config is None 2020-07-16T20:31:04.592 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-07-16T20:31:04.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:31:04.593 INFO:teuthology.orchestra.run.smithi157:> ip netns list 2020-07-16T20:31:04.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:31:04.609 INFO:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2020-07-16T20:31:04.677 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2020-07-16T20:31:04.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:31:04.680 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-07-16T20:31:04.680 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:31:04.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.825+0000 7f59cb446700 1 Processor -- start 2020-07-16T20:31:04.826 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.825+0000 7f59cb446700 1 -- start start 2020-07-16T20:31:04.829 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59cb446700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59c40a48e0 0x7f59c40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59cb446700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 0x7f59c40abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.830 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59cb446700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40a5450 con 0x7f59c40a7fb0 2020-07-16T20:31:04.831 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59cb446700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40a7880 con 0x7f59c40a8420 2020-07-16T20:31:04.832 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59cb446700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40a56b0 con 0x7f59c40a48e0 2020-07-16T20:31:04.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59c91e2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59c40a48e0 0x7f59c40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59c91e2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59c40a48e0 0x7f59c40a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34292/0 (socket says 172.21.15.157:34292) 2020-07-16T20:31:04.833 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59c91e2700 1 -- 172.21.15.157:0/3444122699 learned_addr learned my addr 172.21.15.157:0/3444122699 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:04.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.826+0000 7f59c91e2700 1 -- 172.21.15.157:0/3444122699 >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 msgr2=0x7f59c40abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:04.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c99e3700 1 --2- 172.21.15.157:0/3444122699 >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 0x7f59c40abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c91e2700 1 --2- 172.21.15.157:0/3444122699 >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 0x7f59c40abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c91e2700 1 -- 172.21.15.157:0/3444122699 >> v1:172.21.15.41:6789/0 conn(0x7f59c40a7fb0 legacy=0x7f59c40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:04.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c91e2700 1 -- 172.21.15.157:0/3444122699 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40a5950 con 0x7f59c40a48e0 2020-07-16T20:31:04.835 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c99e3700 1 --2- 172.21.15.157:0/3444122699 >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 0x7f59c40abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:04.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59c91e2700 1 --2- 172.21.15.157:0/3444122699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a48e0 0x7f59c40a4cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f59c41361f0 tx=0x7f59b4006e90).ready entity=mon.1 client_cookie=b619d1d4d9d96e8d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.836 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59b3fff700 1 -- 172.21.15.157:0/3444122699 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b4009930 con 0x7f59c40a48e0 2020-07-16T20:31:04.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59b3fff700 1 -- 172.21.15.157:0/3444122699 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4009a90 con 0x7f59c40a48e0 2020-07-16T20:31:04.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59b3fff700 1 -- 172.21.15.157:0/3444122699 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b4009e30 con 0x7f59c40a48e0 2020-07-16T20:31:04.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 -- 172.21.15.157:0/3444122699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a48e0 msgr2=0x7f59c40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 --2- 172.21.15.157:0/3444122699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a48e0 0x7f59c40a4cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f59c41361f0 tx=0x7f59b4006e90).stop 2020-07-16T20:31:04.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 -- 172.21.15.157:0/3444122699 shutdown_connections 2020-07-16T20:31:04.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 --2- 172.21.15.157:0/3444122699 >> v2:172.21.15.41:3300/0 conn(0x7f59c40a8420 0x7f59c40abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 --2- 172.21.15.157:0/3444122699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a48e0 0x7f59c40a4cc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 -- 172.21.15.157:0/3444122699 >> 172.21.15.157:0/3444122699 conn(0x7f59c4061820 msgr2=0x7f59c409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 -- 172.21.15.157:0/3444122699 shutdown_connections 2020-07-16T20:31:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.827+0000 7f59cb446700 1 -- 172.21.15.157:0/3444122699 wait complete. 2020-07-16T20:31:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.829+0000 7f59cb446700 1 Processor -- start 2020-07-16T20:31:04.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.829+0000 7f59cb446700 1 -- start start 2020-07-16T20:31:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59c40a7fb0 0x7f59c412cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40ab020 con 0x7f59c40a8420 2020-07-16T20:31:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c41494b0 con 0x7f59c40aa890 2020-07-16T20:31:04.842 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40aad40 con 0x7f59c40a7fb0 2020-07-16T20:31:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c91e2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59c40a7fb0 0x7f59c412cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c99e3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f59c40aa890 0x7f59c414ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36990/0 (socket says 172.21.15.157:36990) 2020-07-16T20:31:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c99e3700 1 -- 172.21.15.157:0/1705820184 learned_addr learned my addr 172.21.15.157:0/1705820184 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c91e2700 1 -- 172.21.15.157:0/1705820184 >> v1:172.21.15.157:6789/0 conn(0x7f59c40aa890 legacy=0x7f59c414ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.843 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c91e2700 1 -- 172.21.15.157:0/1705820184 >> v1:172.21.15.41:6789/0 conn(0x7f59c40a8420 legacy=0x7f59c4149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c91e2700 1 -- 172.21.15.157:0/1705820184 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c409fb30 con 0x7f59c40a7fb0 2020-07-16T20:31:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235453548 0 0) 0x7f59c41494b0 con 0x7f59c40aa890 2020-07-16T20:31:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59c91e2700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a7fb0 0x7f59c412cdb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f59c41361f0 tx=0x7f59b4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b401d5d0 con 0x7f59c40a7fb0 2020-07-16T20:31:04.844 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b401d730 con 0x7f59c40a7fb0 2020-07-16T20:31:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c41491a0 con 0x7f59c40a7fb0 2020-07-16T20:31:04.845 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b401da90 con 0x7f59c40a7fb0 2020-07-16T20:31:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.830+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4066690 con 0x7f59c40a7fb0 2020-07-16T20:31:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.831+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c40aae80 con 0x7f59c40a7fb0 2020-07-16T20:31:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.831+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f59b4025030 con 0x7f59c40a7fb0 2020-07-16T20:31:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.832+0000 7f59b17fa700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 0x7f599c052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:04.846 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.832+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f59b40694f0 con 0x7f59c40a7fb0 2020-07-16T20:31:04.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.832+0000 7f59c89e1700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 0x7f599c052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:04.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.832+0000 7f59c89e1700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 0x7f599c052360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f59c412d7a0 tx=0x7f59c00078f0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:04.847 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.835+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f59c40aae80 con 0x7f59c40a7fb0 2020-07-16T20:31:04.989 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.982+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c40aae80 con 0x7f59c40a7fb0 2020-07-16T20:31:04.990 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.983+0000 7f59b17fa700 1 -- 172.21.15.157:0/1705820184 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f59c40aae80 con 0x7f59c40a7fb0 2020-07-16T20:31:04.990 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 msgr2=0x7f599c052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.990 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 0x7f599c052360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f59c412d7a0 tx=0x7f59c00078f0).stop 2020-07-16T20:31:04.991 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a7fb0 msgr2=0x7f59c412cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:04.991 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a7fb0 0x7f59c412cdb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f59c41361f0 tx=0x7f59b4015000).stop 2020-07-16T20:31:04.992 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 shutdown_connections 2020-07-16T20:31:04.992 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f599c04fea0 0x7f599c052360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.992 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 --2- 172.21.15.157:0/1705820184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59c40a7fb0 0x7f59c412cdb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:04.993 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 >> 172.21.15.157:0/1705820184 conn(0x7f59c4061820 msgr2=0x7f59c4130b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:04.993 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 shutdown_connections 2020-07-16T20:31:04.993 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:04.985+0000 7f59cb446700 1 -- 172.21.15.157:0/1705820184 wait complete. 2020-07-16T20:31:04.994 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:04.994 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:31:05.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:32.588806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:42.750526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:46.151313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:48.751540+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:31:05.011 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:31:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.119+0000 7f526d476700 1 Processor -- start 2020-07-16T20:31:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.119+0000 7f526d476700 1 -- start start 2020-07-16T20:31:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f526d476700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 0x7f5268133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f526d476700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f526d476700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5268133cc0 con 0x7f5268133860 2020-07-16T20:31:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f526d476700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680a4710 con 0x7f52680a7470 2020-07-16T20:31:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f526d476700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680a5c00 con 0x7f52680a8a20 2020-07-16T20:31:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f52677fe700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f5266ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 0x7f5268133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f5266ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 0x7f5268133370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:59544/0 (socket says 172.21.15.157:59544) 2020-07-16T20:31:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f5266ffd700 1 -- 172.21.15.157:0/3886215751 learned_addr learned my addr 172.21.15.157:0/3886215751 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f52677fe700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:59648/0 (socket says 172.21.15.157:59648) 2020-07-16T20:31:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.120+0000 7f52667fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5268133860 0x7f52680a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50572/0 (socket says 172.21.15.157:50572) 2020-07-16T20:31:05.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f52677fe700 1 -- 172.21.15.157:0/3886215751 >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 msgr2=0x7f5268133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:05.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f52677fe700 1 --2- 172.21.15.157:0/3886215751 >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 0x7f5268133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f52677fe700 1 -- 172.21.15.157:0/3886215751 >> v1:172.21.15.41:6789/0 conn(0x7f5268133860 legacy=0x7f52680a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f52677fe700 1 -- 172.21.15.157:0/3886215751 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680a9110 con 0x7f52680a8a20 2020-07-16T20:31:05.125 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f52677fe700 1 --2- 172.21.15.157:0/3886215751 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f52600032b0 tx=0x7f52600091d0).ready entity=mon.2 client_cookie=e099a64c0c86ae7d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.126 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f5265ffb700 1 -- 172.21.15.157:0/3886215751 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f526000b9a0 con 0x7f52680a8a20 2020-07-16T20:31:05.126 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f5265ffb700 1 -- 172.21.15.157:0/3886215751 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000bb00 con 0x7f52680a8a20 2020-07-16T20:31:05.126 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f5265ffb700 1 -- 172.21.15.157:0/3886215751 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f526000bc70 con 0x7f52680a8a20 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 -- 172.21.15.157:0/3886215751 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 msgr2=0x7f5268140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 --2- 172.21.15.157:0/3886215751 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f52600032b0 tx=0x7f52600091d0).stop 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 -- 172.21.15.157:0/3886215751 shutdown_connections 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 --2- 172.21.15.157:0/3886215751 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f52680a8a20 0x7f5268140be0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 --2- 172.21.15.157:0/3886215751 >> v2:172.21.15.41:3300/0 conn(0x7f52680a7470 0x7f5268133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 -- 172.21.15.157:0/3886215751 >> 172.21.15.157:0/3886215751 conn(0x7f526809e7e0 msgr2=0x7f526809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 -- 172.21.15.157:0/3886215751 shutdown_connections 2020-07-16T20:31:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.121+0000 7f526d476700 1 -- 172.21.15.157:0/3886215751 wait complete. 2020-07-16T20:31:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 Processor -- start 2020-07-16T20:31:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 -- start start 2020-07-16T20:31:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52680a7470 0x7f526814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526814ac80 con 0x7f5268133860 2020-07-16T20:31:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526809f6f0 con 0x7f526812d990 2020-07-16T20:31:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f526d476700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680aaa90 con 0x7f52680a7470 2020-07-16T20:31:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f5266ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52680a7470 0x7f526814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f52677fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f526812d990 0x7f5268125960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37002/0 (socket says 172.21.15.157:37002) 2020-07-16T20:31:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.123+0000 7f52677fe700 1 -- 172.21.15.157:0/406276378 learned_addr learned my addr 172.21.15.157:0/406276378 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f5266ffd700 1 -- 172.21.15.157:0/406276378 >> v1:172.21.15.157:6789/0 conn(0x7f526812d990 legacy=0x7f5268125960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.134 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f5266ffd700 1 -- 172.21.15.157:0/406276378 >> v1:172.21.15.41:6789/0 conn(0x7f5268133860 legacy=0x7f52680ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.134 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991698725 0 0) 0x7f526809f6f0 con 0x7f526812d990 2020-07-16T20:31:05.135 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f5266ffd700 1 -- 172.21.15.157:0/406276378 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526814af10 con 0x7f52680a7470 2020-07-16T20:31:05.135 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f5266ffd700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52680a7470 0x7f526814a790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5258000fe0 tx=0x7f525c006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.135 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f525c00c7a0 con 0x7f52680a7470 2020-07-16T20:31:05.135 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00c900 con 0x7f52680a7470 2020-07-16T20:31:05.135 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f525c00cc60 con 0x7f52680a7470 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526814b3b0 con 0x7f52680a7470 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.124+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526812dde0 con 0x7f52680a7470 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.125+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526814b0a0 con 0x7f52680a7470 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.125+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f525c0123f0 con 0x7f52680a7470 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.125+0000 7f524effd700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 0x7f5244052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.136 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.125+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f525c067b10 con 0x7f52680a7470 2020-07-16T20:31:05.137 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.125+0000 7f52667fc700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 0x7f5244052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.137 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.126+0000 7f52667fc700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 0x7f5244052360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5258001160 tx=0x7f52580077f0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.137 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.129+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f525c040240 con 0x7f52680a7470 2020-07-16T20:31:05.276 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.275+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5268057490 con 0x7f52680a7470 2020-07-16T20:31:05.276 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.275+0000 7f524effd700 1 -- 172.21.15.157:0/406276378 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f525c043860 con 0x7f52680a7470 2020-07-16T20:31:05.277 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2020-07-16T20:31:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 msgr2=0x7f5244052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.279 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 0x7f5244052360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5258001160 tx=0x7f52580077f0).stop 2020-07-16T20:31:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52680a7470 msgr2=0x7f526814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52680a7470 0x7f526814a790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5258000fe0 tx=0x7f525c006e90).stop 2020-07-16T20:31:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 shutdown_connections 2020-07-16T20:31:05.280 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f524404fea0 0x7f5244052360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 --2- 172.21.15.157:0/406276378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52680a7470 0x7f526814a790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 >> 172.21.15.157:0/406276378 conn(0x7f526809e7e0 msgr2=0x7f526809ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 shutdown_connections 2020-07-16T20:31:05.281 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.277+0000 7f526d476700 1 -- 172.21.15.157:0/406276378 wait complete. 2020-07-16T20:31:05.288 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:31:05.399 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 Processor -- start 2020-07-16T20:31:05.400 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 -- start start 2020-07-16T20:31:05.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a72f0 0x7f889c13d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 0x7f889c13d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.405 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c05d610 con 0x7f889c136480 2020-07-16T20:31:05.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c0a7790 con 0x7f889c0a8ff0 2020-07-16T20:31:05.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a3a06700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c13cba0 con 0x7f889c0a72f0 2020-07-16T20:31:05.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.399+0000 7f88a17a2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a72f0 0x7f889c13d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.406 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a72f0 0x7f889c13d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34318/0 (socket says 172.21.15.157:34318) 2020-07-16T20:31:05.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 -- 172.21.15.157:0/560839991 learned_addr learned my addr 172.21.15.157:0/560839991 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:05.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/560839991 >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 0x7f889c13d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 -- 172.21.15.157:0/560839991 >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 msgr2=0x7f889c13d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:05.407 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 --2- 172.21.15.157:0/560839991 >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 0x7f889c13d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 -- 172.21.15.157:0/560839991 >> v1:172.21.15.41:6789/0 conn(0x7f889c136480 legacy=0x7f889c136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 -- 172.21.15.157:0/560839991 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0a7a30 con 0x7f889c0a72f0 2020-07-16T20:31:05.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/560839991 >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 0x7f889c13d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:05.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a17a2700 1 --2- 172.21.15.157:0/560839991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a72f0 0x7f889c13d040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f888c002f30 tx=0x7f888c006e90).ready entity=mon.1 client_cookie=178571459589a85e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.408 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f888bfff700 1 -- 172.21.15.157:0/560839991 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c0099c0 con 0x7f889c0a72f0 2020-07-16T20:31:05.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f888bfff700 1 -- 172.21.15.157:0/560839991 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c009b20 con 0x7f889c0a72f0 2020-07-16T20:31:05.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f888bfff700 1 -- 172.21.15.157:0/560839991 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c009e80 con 0x7f889c0a72f0 2020-07-16T20:31:05.409 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 -- 172.21.15.157:0/560839991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a72f0 msgr2=0x7f889c13d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 --2- 172.21.15.157:0/560839991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a72f0 0x7f889c13d040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f888c002f30 tx=0x7f888c006e90).stop 2020-07-16T20:31:05.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 -- 172.21.15.157:0/560839991 shutdown_connections 2020-07-16T20:31:05.410 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 --2- 172.21.15.157:0/560839991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a72f0 0x7f889c13d040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 --2- 172.21.15.157:0/560839991 >> v2:172.21.15.41:3300/0 conn(0x7f889c0a8ff0 0x7f889c13d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 -- 172.21.15.157:0/560839991 >> 172.21.15.157:0/560839991 conn(0x7f889c0628b0 msgr2=0x7f889c05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 -- 172.21.15.157:0/560839991 shutdown_connections 2020-07-16T20:31:05.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.400+0000 7f88a3a06700 1 -- 172.21.15.157:0/560839991 wait complete. 2020-07-16T20:31:05.411 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 Processor -- start 2020-07-16T20:31:05.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 -- start start 2020-07-16T20:31:05.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a8ff0 0x7f889c13b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 0x7f889c13a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 0x7f889c12bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.412 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c131590 con 0x7f889c12dd70 2020-07-16T20:31:05.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c12e280 con 0x7f889c0a8ff0 2020-07-16T20:31:05.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a3a06700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c131780 con 0x7f889c136480 2020-07-16T20:31:05.413 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a17a2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a8ff0 0x7f889c13b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a17a2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f889c0a8ff0 0x7f889c13b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34326/0 (socket says 172.21.15.157:34326) 2020-07-16T20:31:05.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.402+0000 7f88a17a2700 1 -- 172.21.15.157:0/3314343198 learned_addr learned my addr 172.21.15.157:0/3314343198 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:05.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 0x7f889c13a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a1fa3700 1 --2- 172.21.15.157:0/3314343198 >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 0x7f889c12bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.414 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 -- 172.21.15.157:0/3314343198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 msgr2=0x7f889c13a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 0x7f889c13a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 -- 172.21.15.157:0/3314343198 >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 msgr2=0x7f889c12bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 --2- 172.21.15.157:0/3314343198 >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 0x7f889c12bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.415 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 -- 172.21.15.157:0/3314343198 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c13adb0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 0x7f889c13a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a1fa3700 1 --2- 172.21.15.157:0/3314343198 >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 0x7f889c12bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a17a2700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a8ff0 0x7f889c13b620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f888c002f30 tx=0x7f888c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c0099c0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.416 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c01d5d0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c135d90 con 0x7f889c0a8ff0 2020-07-16T20:31:05.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c01d930 con 0x7f889c0a8ff0 2020-07-16T20:31:05.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.403+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c131c20 con 0x7f889c0a8ff0 2020-07-16T20:31:05.417 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.404+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c057490 con 0x7f889c0a8ff0 2020-07-16T20:31:05.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.404+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f888c025030 con 0x7f889c0a8ff0 2020-07-16T20:31:05.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.404+0000 7f88897fa700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 0x7f88740524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.404+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f888c069440 con 0x7f889c0a8ff0 2020-07-16T20:31:05.418 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.404+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 0x7f88740524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.405+0000 7f88a0fa1700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 0x7f88740524e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f889800c000 tx=0x7f8898008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.419 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.408+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f888c041bd0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.558 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.557+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f889c043fd0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.559 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.557+0000 7f88897fa700 1 -- 172.21.15.157:0/3314343198 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f888c0451f0 con 0x7f889c0a8ff0 2020-07-16T20:31:05.559 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:05.560 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.558+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 msgr2=0x7f88740524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.560 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.558+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 0x7f88740524e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f889800c000 tx=0x7f8898008040).stop 2020-07-16T20:31:05.561 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.558+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a8ff0 msgr2=0x7f889c13b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.561 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.558+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a8ff0 0x7f889c13b620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f888c002f30 tx=0x7f888c015000).stop 2020-07-16T20:31:05.562 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 shutdown_connections 2020-07-16T20:31:05.562 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8874050020 0x7f88740524e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.562 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> v2:172.21.15.41:3300/0 conn(0x7f889c12dd70 0x7f889c12bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.562 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f889c0a8ff0 0x7f889c13b620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.563 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 --2- 172.21.15.157:0/3314343198 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f889c136480 0x7f889c13a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.563 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 >> 172.21.15.157:0/3314343198 conn(0x7f889c0628b0 msgr2=0x7f889c139d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.563 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 shutdown_connections 2020-07-16T20:31:05.563 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.559+0000 7f88a3a06700 1 -- 172.21.15.157:0/3314343198 wait complete. 2020-07-16T20:31:05.569 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:31:05.678 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.677+0000 7fe35cccb700 1 Processor -- start 2020-07-16T20:31:05.678 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.677+0000 7fe35cccb700 1 -- start start 2020-07-16T20:31:05.684 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3580a7470 0x7fe358133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.684 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe3580a8a20 0x7fe358140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.684 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358133cc0 con 0x7fe358133860 2020-07-16T20:31:05.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a4710 con 0x7fe3580a8a20 2020-07-16T20:31:05.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a5c00 con 0x7fe3580a7470 2020-07-16T20:31:05.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3580a7470 0x7fe358133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3580a7470 0x7fe358133370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34332/0 (socket says 172.21.15.157:34332) 2020-07-16T20:31:05.685 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 -- 172.21.15.157:0/3889768277 learned_addr learned my addr 172.21.15.157:0/3889768277 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:05.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe355d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe358133860 0x7fe3580a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37020/0 (socket says 172.21.15.157:37020) 2020-07-16T20:31:05.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe356d9d700 1 --2- 172.21.15.157:0/3889768277 >> v2:172.21.15.41:3300/0 conn(0x7fe3580a8a20 0x7fe358140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 -- 172.21.15.157:0/3889768277 >> v2:172.21.15.41:3300/0 conn(0x7fe3580a8a20 msgr2=0x7fe358140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:05.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 --2- 172.21.15.157:0/3889768277 >> v2:172.21.15.41:3300/0 conn(0x7fe3580a8a20 0x7fe358140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.686 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 -- 172.21.15.157:0/3889768277 >> v1:172.21.15.157:6789/0 conn(0x7fe358133860 legacy=0x7fe3580a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 -- 172.21.15.157:0/3889768277 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580a9110 con 0x7fe3580a7470 2020-07-16T20:31:05.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35659c700 1 --2- 172.21.15.157:0/3889768277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3580a7470 0x7fe358133370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe3500032b0 tx=0x7fe35000b510).ready entity=mon.1 client_cookie=bd0739455667edad server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35559a700 1 -- 172.21.15.157:0/3889768277 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe350010660 con 0x7fe3580a7470 2020-07-16T20:31:05.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35559a700 1 -- 172.21.15.157:0/3889768277 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500107c0 con 0x7fe3580a7470 2020-07-16T20:31:05.687 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35559a700 1 -- 172.21.15.157:0/3889768277 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe350010b20 con 0x7fe3580a7470 2020-07-16T20:31:05.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- 172.21.15.157:0/3889768277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3580a7470 msgr2=0x7fe358133370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 --2- 172.21.15.157:0/3889768277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3580a7470 0x7fe358133370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe3500032b0 tx=0x7fe35000b510).stop 2020-07-16T20:31:05.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- 172.21.15.157:0/3889768277 shutdown_connections 2020-07-16T20:31:05.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 --2- 172.21.15.157:0/3889768277 >> v2:172.21.15.41:3300/0 conn(0x7fe3580a8a20 0x7fe358140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.688 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 --2- 172.21.15.157:0/3889768277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3580a7470 0x7fe358133370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.678+0000 7fe35cccb700 1 -- 172.21.15.157:0/3889768277 >> 172.21.15.157:0/3889768277 conn(0x7fe35809e7e0 msgr2=0x7fe35809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.679+0000 7fe35cccb700 1 -- 172.21.15.157:0/3889768277 shutdown_connections 2020-07-16T20:31:05.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.679+0000 7fe35cccb700 1 -- 172.21.15.157:0/3889768277 wait complete. 2020-07-16T20:31:05.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 Processor -- start 2020-07-16T20:31:05.689 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 -- start start 2020-07-16T20:31:05.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe358133860 0x7fe3581363a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe358135d30 0x7fe358139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358134e90 con 0x7fe3580a8a20 2020-07-16T20:31:05.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3581350c0 con 0x7fe358133860 2020-07-16T20:31:05.690 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35cccb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe358135360 con 0x7fe358135d30 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35659c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe3580a8a20 0x7fe358149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37026/0 (socket says 172.21.15.157:37026) 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe35659c700 1 -- 172.21.15.157:0/1822452365 learned_addr learned my addr 172.21.15.157:0/1822452365 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.680+0000 7fe356d9d700 1 --2- 172.21.15.157:0/1822452365 >> v2:172.21.15.157:3300/0 conn(0x7fe358135d30 0x7fe358139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe355d9b700 1 --2- 172.21.15.157:0/1822452365 >> v2:172.21.15.41:3300/0 conn(0x7fe358133860 0x7fe3581363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766529441 0 0) 0x7fe358134e90 con 0x7fe3580a8a20 2020-07-16T20:31:05.691 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe334003240 con 0x7fe3580a8a20 2020-07-16T20:31:05.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe356d9d700 1 -- 172.21.15.157:0/1822452365 >> v2:172.21.15.41:3300/0 conn(0x7fe358133860 msgr2=0x7fe3581363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe356d9d700 1 --2- 172.21.15.157:0/1822452365 >> v2:172.21.15.41:3300/0 conn(0x7fe358133860 0x7fe3581363a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe356d9d700 1 -- 172.21.15.157:0/1822452365 >> v1:172.21.15.157:6789/0 conn(0x7fe3580a8a20 legacy=0x7fe358149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe356d9d700 1 -- 172.21.15.157:0/1822452365 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358134220 con 0x7fe358135d30 2020-07-16T20:31:05.692 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe356d9d700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe358135d30 0x7fe358139e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fe34800a000 tx=0x7fe348008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34800f830 con 0x7fe358135d30 2020-07-16T20:31:05.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800f990 con 0x7fe358135d30 2020-07-16T20:31:05.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3581386a0 con 0x7fe358135d30 2020-07-16T20:31:05.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34800fcf0 con 0x7fe358135d30 2020-07-16T20:31:05.693 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.681+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe358135a40 con 0x7fe358135d30 2020-07-16T20:31:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.682+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe358057490 con 0x7fe358135d30 2020-07-16T20:31:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.683+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fe348013480 con 0x7fe358135d30 2020-07-16T20:31:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.683+0000 7fe34e7fc700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 0x7fe334052840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.683+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe3480684b0 con 0x7fe358135d30 2020-07-16T20:31:05.694 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.683+0000 7fe35659c700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 0x7fe334052840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.683+0000 7fe35659c700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 0x7fe334052840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe35000e000 tx=0x7fe3580a4a20).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.695 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.686+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fe348040b40 con 0x7fe358135d30 2020-07-16T20:31:05.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.833+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe358043fd0 con 0x7fe358135d30 2020-07-16T20:31:05.834 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.833+0000 7fe34e7fc700 1 -- 172.21.15.157:0/1822452365 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe3480210a0 con 0x7fe358135d30 2020-07-16T20:31:05.835 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:05.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.834+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 msgr2=0x7fe334052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.834+0000 7fe35cccb700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 0x7fe334052840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe35000e000 tx=0x7fe3580a4a20).stop 2020-07-16T20:31:05.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe358135d30 msgr2=0x7fe358139e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.837 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe358135d30 0x7fe358139e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fe34800a000 tx=0x7fe348008040).stop 2020-07-16T20:31:05.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 shutdown_connections 2020-07-16T20:31:05.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fe334050380 0x7fe334052840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 --2- 172.21.15.157:0/1822452365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe358135d30 0x7fe358139e00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.838 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 --2- 172.21.15.157:0/1822452365 >> v2:172.21.15.41:3300/0 conn(0x7fe358133860 0x7fe3581363a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 >> 172.21.15.157:0/1822452365 conn(0x7fe35809e7e0 msgr2=0x7fe35809ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 shutdown_connections 2020-07-16T20:31:05.839 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.835+0000 7fe35cccb700 1 -- 172.21.15.157:0/1822452365 wait complete. 2020-07-16T20:31:05.845 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:31:05.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.954+0000 7f5d4571a700 1 Processor -- start 2020-07-16T20:31:05.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.954+0000 7f5d4571a700 1 -- start start 2020-07-16T20:31:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d4571a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5d400a8a20 0x7f5d40141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d4571a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400a4710 con 0x7f5d40133a80 2020-07-16T20:31:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d4571a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400a5c00 con 0x7f5d400a7470 2020-07-16T20:31:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d4571a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400a9110 con 0x7f5d400a8a20 2020-07-16T20:31:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3effd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5d400a7470 0x7f5d40133370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37034/0 (socket says 172.21.15.157:37034) 2020-07-16T20:31:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3effd700 1 -- 172.21.15.157:0/2387033742 learned_addr learned my addr 172.21.15.157:0/2387033742 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3f7fe700 1 --2- 172.21.15.157:0/2387033742 >> v2:172.21.15.41:3300/0 conn(0x7f5d400a8a20 0x7f5d40141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3dffb700 1 -- 172.21.15.157:0/2387033742 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173355031 0 0) 0x7f5d400a5c00 con 0x7f5d400a7470 2020-07-16T20:31:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3dffb700 1 -- 172.21.15.157:0/2387033742 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d2c003240 con 0x7f5d400a7470 2020-07-16T20:31:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3f7fe700 1 -- 172.21.15.157:0/2387033742 >> v1:172.21.15.157:6789/0 conn(0x7f5d400a7470 legacy=0x7f5d40133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.960 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3f7fe700 1 -- 172.21.15.157:0/2387033742 >> v1:172.21.15.41:6789/0 conn(0x7f5d40133a80 legacy=0x7f5d400a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.960 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.955+0000 7f5d3f7fe700 1 -- 172.21.15.157:0/2387033742 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400a4cc0 con 0x7f5d400a8a20 2020-07-16T20:31:05.960 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d3f7fe700 1 --2- 172.21.15.157:0/2387033742 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d400a8a20 0x7f5d40141bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5d380032b0 tx=0x7f5d380091d0).ready entity=mon.0 client_cookie=b1058736ffccfdab server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.960 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d3dffb700 1 -- 172.21.15.157:0/2387033742 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d3800b9a0 con 0x7f5d400a8a20 2020-07-16T20:31:05.960 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d3dffb700 1 -- 172.21.15.157:0/2387033742 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800bb00 con 0x7f5d400a8a20 2020-07-16T20:31:05.961 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d3dffb700 1 -- 172.21.15.157:0/2387033742 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d3800bc70 con 0x7f5d400a8a20 2020-07-16T20:31:05.961 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 -- 172.21.15.157:0/2387033742 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d400a8a20 msgr2=0x7f5d40141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.961 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 --2- 172.21.15.157:0/2387033742 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d400a8a20 0x7f5d40141bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5d380032b0 tx=0x7f5d380091d0).stop 2020-07-16T20:31:05.962 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 -- 172.21.15.157:0/2387033742 shutdown_connections 2020-07-16T20:31:05.962 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 --2- 172.21.15.157:0/2387033742 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d400a8a20 0x7f5d40141bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.962 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 -- 172.21.15.157:0/2387033742 >> 172.21.15.157:0/2387033742 conn(0x7f5d4009e7e0 msgr2=0x7f5d4009ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:05.963 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 -- 172.21.15.157:0/2387033742 shutdown_connections 2020-07-16T20:31:05.963 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.956+0000 7f5d4571a700 1 -- 172.21.15.157:0/2387033742 wait complete. 2020-07-16T20:31:05.965 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.957+0000 7f5d4571a700 1 Processor -- start 2020-07-16T20:31:05.966 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.957+0000 7f5d4571a700 1 -- start start 2020-07-16T20:31:05.966 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d4571a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d400a7470 0x7f5d400a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.966 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d4571a700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 0x7f5d400aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.966 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d4571a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4014b210 con 0x7f5d40133a80 2020-07-16T20:31:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d4571a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400aac30 con 0x7f5d400a7470 2020-07-16T20:31:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d4571a700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400aae50 con 0x7f5d400ac310 2020-07-16T20:31:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d400a7470 0x7f5d400a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3e7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5d40133a80 0x7f5d4014ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37042/0 (socket says 172.21.15.157:37042) 2020-07-16T20:31:05.967 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3e7fc700 1 -- 172.21.15.157:0/436186519 learned_addr learned my addr 172.21.15.157:0/436186519 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3f7fe700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 0x7f5d400aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3effd700 1 -- 172.21.15.157:0/436186519 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 msgr2=0x7f5d400aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3effd700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 0x7f5d400aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3effd700 1 -- 172.21.15.157:0/436186519 >> v1:172.21.15.157:6789/0 conn(0x7f5d40133a80 legacy=0x7f5d4014ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270671571 0 0) 0x7f5d4014b210 con 0x7f5d40133a80 2020-07-16T20:31:05.968 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3effd700 1 -- 172.21.15.157:0/436186519 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4014a3c0 con 0x7f5d400a7470 2020-07-16T20:31:05.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.958+0000 7f5d3f7fe700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 0x7f5d400aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:05.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d3effd700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d400a7470 0x7f5d400a6360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f5d34001110 tx=0x7f5d34007980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d340072e0 con 0x7f5d400a7470 2020-07-16T20:31:05.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34007440 con 0x7f5d400a7470 2020-07-16T20:31:05.969 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4014a660 con 0x7f5d400a7470 2020-07-16T20:31:05.970 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d340057e0 con 0x7f5d400a7470 2020-07-16T20:31:05.970 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.959+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d40147450 con 0x7f5d400a7470 2020-07-16T20:31:05.970 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5d34010070 con 0x7f5d400a7470 2020-07-16T20:31:05.970 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4014a7f0 con 0x7f5d400a7470 2020-07-16T20:31:05.970 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d26ffd700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 0x7f5d1c052300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:05.971 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5d34067280 con 0x7f5d400a7470 2020-07-16T20:31:05.971 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d3e7fc700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 0x7f5d1c052300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:05.971 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.960+0000 7f5d3e7fc700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 0x7f5d1c052300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5d30001220 tx=0x7f5d300077a0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:05.971 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:05.964+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5d3403f990 con 0x7f5d400a7470 2020-07-16T20:31:06.111 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.110+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d40057490 con 0x7f5d400a7470 2020-07-16T20:31:06.111 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.110+0000 7f5d26ffd700 1 -- 172.21.15.157:0/436186519 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5d34042fb0 con 0x7f5d400a7470 2020-07-16T20:31:06.111 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 8 2020-07-16T20:31:06.112 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 msgr2=0x7f5d1c052300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.112 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 0x7f5d1c052300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5d30001220 tx=0x7f5d300077a0).stop 2020-07-16T20:31:06.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d400a7470 msgr2=0x7f5d400a6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d400a7470 0x7f5d400a6360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f5d34001110 tx=0x7f5d34007980).stop 2020-07-16T20:31:06.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 shutdown_connections 2020-07-16T20:31:06.113 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d1c04fe40 0x7f5d1c052300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d400ac310 0x7f5d400aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 --2- 172.21.15.157:0/436186519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d400a7470 0x7f5d400a6360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 >> 172.21.15.157:0/436186519 conn(0x7f5d4009e7e0 msgr2=0x7f5d40132000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:06.114 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 shutdown_connections 2020-07-16T20:31:06.115 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.112+0000 7f5d4571a700 1 -- 172.21.15.157:0/436186519 wait complete. 2020-07-16T20:31:06.122 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-07-16T20:31:06.123 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:31:06.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.229+0000 7f7381776700 1 Processor -- start 2020-07-16T20:31:06.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.229+0000 7f7381776700 1 -- start start 2020-07-16T20:31:06.237 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7381776700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f737c133390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.238 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7381776700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0a5450 con 0x7f737c0a48e0 2020-07-16T20:31:06.238 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7381776700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0a7880 con 0x7f737c0a86c0 2020-07-16T20:31:06.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7381776700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0a56b0 con 0x7f737c0a4cc0 2020-07-16T20:31:06.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f737a7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f737c0a86c0 0x7f737c132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37050/0 (socket says 172.21.15.157:37050) 2020-07-16T20:31:06.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f737a7fc700 1 -- 172.21.15.157:0/2590820242 learned_addr learned my addr 172.21.15.157:0/2590820242 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:06.239 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f737b7fe700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f737c133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637414582 0 0) 0x7f737c0a7880 con 0x7f737c0a86c0 2020-07-16T20:31:06.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c003240 con 0x7f737c0a86c0 2020-07-16T20:31:06.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1542474296 0 0) 0x7f735c003240 con 0x7f737c0a86c0 2020-07-16T20:31:06.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 msgr2=0x7f737c133390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:06.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f737c133390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 >> v1:172.21.15.41:6789/0 conn(0x7f737c0a48e0 legacy=0x7f737c0a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0a5950 con 0x7f737c0a86c0 2020-07-16T20:31:06.241 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f736c0016d0 con 0x7f737c0a86c0 2020-07-16T20:31:06.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 >> v1:172.21.15.157:6789/0 conn(0x7f737c0a86c0 legacy=0x7f737c132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c003730 0x7f735c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f735c0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0049d0 0x7f735c004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0a56b0 con 0x7f735c0049d0 2020-07-16T20:31:06.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c004140 con 0x7f735c003730 2020-07-16T20:31:06.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.230+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c004300 con 0x7f737c0a4cc0 2020-07-16T20:31:06.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c003730 0x7f735c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737b7fe700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0049d0 0x7f735c004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737a7fc700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f735c0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 -- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 msgr2=0x7f735c0044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:06.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f737c0a4cc0 0x7f735c0044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 -- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0049d0 msgr2=0x7f735c004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:06.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0049d0 0x7f735c004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 -- 172.21.15.157:0/2590820242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c003240 con 0x7f735c003730 2020-07-16T20:31:06.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737b7fe700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0049d0 0x7f735c004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:06.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737affd700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c003730 0x7f735c003b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7364000fe0 tx=0x7f7364007ac0).ready entity=mon.1 client_cookie=26048ed15266e5b5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:06.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736400c620 con 0x7f735c003730 2020-07-16T20:31:06.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400c780 con 0x7f735c003730 2020-07-16T20:31:06.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7379ffb700 1 -- 172.21.15.157:0/2590820242 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736400cae0 con 0x7f735c003730 2020-07-16T20:31:06.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 -- 172.21.15.157:0/2590820242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c003730 msgr2=0x7f735c003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.250 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 --2- 172.21.15.157:0/2590820242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c003730 0x7f735c003b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7364000fe0 tx=0x7f7364007ac0).stop 2020-07-16T20:31:06.251 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f737b7fe700 1 -- 172.21.15.157:0/2590820242 reap_dead start 2020-07-16T20:31:06.251 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 -- 172.21.15.157:0/2590820242 shutdown_connections 2020-07-16T20:31:06.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 -- 172.21.15.157:0/2590820242 >> 172.21.15.157:0/2590820242 conn(0x7f737c061820 msgr2=0x7f737c09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:06.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 -- 172.21.15.157:0/2590820242 shutdown_connections 2020-07-16T20:31:06.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.231+0000 7f7381776700 1 -- 172.21.15.157:0/2590820242 wait complete. 2020-07-16T20:31:06.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 Processor -- start 2020-07-16T20:31:06.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 -- start start 2020-07-16T20:31:06.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f737c137550 0x7f737c137930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f737c139fb0 0x7f737c0a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c13a480 con 0x7f737c138980 2020-07-16T20:31:06.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c138240 con 0x7f737c137550 2020-07-16T20:31:06.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f7381776700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c1384e0 con 0x7f737c139fb0 2020-07-16T20:31:06.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f737b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f737c139fb0 0x7f737c0a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f737b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f737c139fb0 0x7f737c0a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34376/0 (socket says 172.21.15.157:34376) 2020-07-16T20:31:06.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.233+0000 7f737b7fe700 1 -- 172.21.15.157:0/3918037158 learned_addr learned my addr 172.21.15.157:0/3918037158 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:06.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737affd700 1 --2- 172.21.15.157:0/3918037158 >> v2:172.21.15.41:3300/0 conn(0x7f737c137550 0x7f737c137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737b7fe700 1 -- 172.21.15.157:0/3918037158 >> v2:172.21.15.41:3300/0 conn(0x7f737c137550 msgr2=0x7f737c137930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737b7fe700 1 --2- 172.21.15.157:0/3918037158 >> v2:172.21.15.41:3300/0 conn(0x7f737c137550 0x7f737c137930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737b7fe700 1 -- 172.21.15.157:0/3918037158 >> v1:172.21.15.41:6789/0 conn(0x7f737c138980 legacy=0x7f737c148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737b7fe700 1 -- 172.21.15.157:0/3918037158 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c09f600 con 0x7f737c139fb0 2020-07-16T20:31:06.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f737b7fe700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f737c139fb0 0x7f737c0a1c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f737400b000 tx=0x7f7374008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:06.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f737400e970 con 0x7f737c139fb0 2020-07-16T20:31:06.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737400ead0 con 0x7f737c139fb0 2020-07-16T20:31:06.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0a2110 con 0x7f737c139fb0 2020-07-16T20:31:06.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f737400ee30 con 0x7f737c139fb0 2020-07-16T20:31:06.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.234+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0a25b0 con 0x7f737c139fb0 2020-07-16T20:31:06.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.235+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c057490 con 0x7f737c139fb0 2020-07-16T20:31:06.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.235+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7374014470 con 0x7f737c139fb0 2020-07-16T20:31:06.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.235+0000 7f7372ffd700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 0x7f73580524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:06.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.235+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7374068160 con 0x7f737c139fb0 2020-07-16T20:31:06.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.235+0000 7f737affd700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 0x7f73580524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:06.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.236+0000 7f737affd700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 0x7f73580524d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7364019000 tx=0x7f7364016000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:06.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.239+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f7374040890 con 0x7f737c139fb0 2020-07-16T20:31:06.433 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.432+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f737c09f790 con 0x7f737c139fb0 2020-07-16T20:31:06.433 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.432+0000 7f7372ffd700 1 -- 172.21.15.157:0/3918037158 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2133 (secure 0 0 0) 0x7f7374018020 con 0x7f737c139fb0 2020-07-16T20:31:06.434 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:06.434 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3123870471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3123870471},{"type":"v1","addr":"172.21.15.41:6833","nonce":3123870471}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:51.081808+0000","modified":"2020-07-16T20:30:54.743225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4384":{"gid":4384,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.157:6835/3430841144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3430841144},{"type":"v1","addr":"172.21.15.157:6835","nonce":3430841144}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:31:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 msgr2=0x7f73580524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 0x7f73580524d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7364019000 tx=0x7f7364016000).stop 2020-07-16T20:31:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f737c139fb0 msgr2=0x7f737c0a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f737c139fb0 0x7f737c0a1c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f737400b000 tx=0x7f7374008040).stop 2020-07-16T20:31:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 shutdown_connections 2020-07-16T20:31:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f7358050010 0x7f73580524d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 --2- 172.21.15.157:0/3918037158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f737c139fb0 0x7f737c0a1c20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 --2- 172.21.15.157:0/3918037158 >> v2:172.21.15.41:3300/0 conn(0x7f737c137550 0x7f737c137930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 >> 172.21.15.157:0/3918037158 conn(0x7f737c061820 msgr2=0x7f737c130290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 shutdown_connections 2020-07-16T20:31:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:06.434+0000 7f7381776700 1 -- 172.21.15.157:0/3918037158 wait complete. 2020-07-16T20:31:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 6 2020-07-16T20:31:06.647 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-16T20:30:51.081808+0000', 'modified': '2020-07-16T20:30:54.743225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4384}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4384': {'gid': 4384, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.157:6835/3430841144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 3430841144}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 3430841144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-16T20:31:06.647 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-16T20:31:06.648 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-07-16T20:31:06.782 INFO:teuthology.orchestra.run.smithi157.stdout:{"cluster_fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","whoami":0,"id":4384,"want_state":"up:active","state":"up:active","rank_uptime":13.024219321,"mdsmap_epoch":6,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":13.325487386000001} 2020-07-16T20:31:06.783 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "cfd2f8dd-09bb-4e6b-8709-0ded1adfce51", "id": 4384, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 13.024219321, "state": "up:active", "uptime": 13.325487386, "want_state": "up:active", "whoami": 0 } 2020-07-16T20:31:06.783 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-07-16T20:31:06.784 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-07-16T20:31:06.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:31:06.785 INFO:teuthology.orchestra.run.smithi157:> ip addr 2020-07-16T20:31:06.800 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-07-16T20:31:06.800 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-07-16T20:31:06.800 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2020-07-16T20:31:06.800 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:31:06.801 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2020-07-16T20:31:06.801 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:31:06.801 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:31:06.801 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:31:06.801 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:31:06.802 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:31:06.802 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:31:06.802 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:31:06.802 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-07-16T20:31:06.802 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:31:06.803 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-07-16T20:31:06.803 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42836sec preferred_lft 42836sec 2020-07-16T20:31:06.803 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2020-07-16T20:31:06.803 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:31:06.804 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-07-16T20:31:06.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:31:06.804 INFO:teuthology.orchestra.run.smithi157:> (cd /home/teuthworker && exec sudo bash -c ' 2020-07-16T20:31:06.805 INFO:teuthology.orchestra.run.smithi157:> set -e 2020-07-16T20:31:06.805 INFO:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2020-07-16T20:31:06.806 INFO:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2020-07-16T20:31:06.806 INFO:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2020-07-16T20:31:06.806 INFO:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-07-16T20:31:06.807 INFO:teuthology.orchestra.run.smithi157:> ') 2020-07-16T20:31:06.853 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 0: cd: /home/teuthworker: No such file or directory 2020-07-16T20:31:06.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:31:06.855 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 93, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/ceph_fuse.py", line 157, in task info["mount"].mount(mountpoint=mountpoint, mount_path=mount_path) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/fuse_mount.py", line 33, in mount self.setup_netns() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 303, in setup_netns self._setup_brx_and_nat() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 136, in _setup_brx_and_nat """, cwd=os.getcwd(), timeout=(5*60), omit_sudo=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 529, in run_shell_payload return self.run_shell(["bash", "-c", Raw(f"'{payload}'")], **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 526, in run_shell timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 1: "(cd /home/teuthworker && exec sudo bash -c '\n set -e\n sudo ip link add name ceph-brx type bridge\n sudo ip addr flush dev ceph-brx\n sudo ip link set ceph-brx up\n sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx\n ')" 2020-07-16T20:31:06.883 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=4a98bce6d74044b58a8b18f5da2019e8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 93, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/ceph_fuse.py", line 157, in task info["mount"].mount(mountpoint=mountpoint, mount_path=mount_path) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/fuse_mount.py", line 33, in mount self.setup_netns() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 303, in setup_netns self._setup_brx_and_nat() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 136, in _setup_brx_and_nat """, cwd=os.getcwd(), timeout=(5*60), omit_sudo=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 529, in run_shell_payload return self.run_shell(["bash", "-c", Raw(f"'{payload}'")], **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 526, in run_shell timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 1: "(cd /home/teuthworker && exec sudo bash -c '\n set -e\n sudo ip link add name ceph-brx type bridge\n sudo ip addr flush dev ceph-brx\n sudo ip link set ceph-brx up\n sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx\n ')" 2020-07-16T20:31:06.884 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-07-16T20:31:06.896 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-07-16T20:31:06.907 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-07-16T20:31:06.908 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:31:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.017+0000 7f5d88832700 1 Processor -- start 2020-07-16T20:31:07.018 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.017+0000 7f5d88832700 1 -- start start 2020-07-16T20:31:07.030 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d88832700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d840a4d10 0x7f5d841330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.030 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d88832700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5d841335a0 0x7f5d84140b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.031 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d88832700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d840a7880 con 0x7f5d840a4930 2020-07-16T20:31:07.032 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d88832700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840a55c0 con 0x7f5d841335a0 2020-07-16T20:31:07.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d88832700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840a5860 con 0x7f5d840a4d10 2020-07-16T20:31:07.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d840a4d10 0x7f5d841330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d840a4d10 0x7f5d841330b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34380/0 (socket says 172.21.15.157:34380) 2020-07-16T20:31:07.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 -- 172.21.15.157:0/702054063 learned_addr learned my addr 172.21.15.157:0/702054063 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:07.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d82d9d700 1 --2- 172.21.15.157:0/702054063 >> v2:172.21.15.41:3300/0 conn(0x7f5d841335a0 0x7f5d84140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 -- 172.21.15.157:0/702054063 >> v2:172.21.15.41:3300/0 conn(0x7f5d841335a0 msgr2=0x7f5d84140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:07.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 --2- 172.21.15.157:0/702054063 >> v2:172.21.15.41:3300/0 conn(0x7f5d841335a0 0x7f5d84140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.040 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 -- 172.21.15.157:0/702054063 >> v1:172.21.15.41:6789/0 conn(0x7f5d840a4930 legacy=0x7f5d840a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.040 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.018+0000 7f5d7bfff700 1 -- 172.21.15.157:0/702054063 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840a33d0 con 0x7f5d840a4d10 2020-07-16T20:31:07.041 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d7bfff700 1 --2- 172.21.15.157:0/702054063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4d10 0x7f5d841330b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5d6c002f30 tx=0x7f5d6c006e90).ready entity=mon.1 client_cookie=73be4ebc574ef6f5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.041 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d81d9b700 1 -- 172.21.15.157:0/702054063 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6c009850 con 0x7f5d840a4d10 2020-07-16T20:31:07.044 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d81d9b700 1 -- 172.21.15.157:0/702054063 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0099b0 con 0x7f5d840a4d10 2020-07-16T20:31:07.044 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d81d9b700 1 -- 172.21.15.157:0/702054063 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6c009d10 con 0x7f5d840a4d10 2020-07-16T20:31:07.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 -- 172.21.15.157:0/702054063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4d10 msgr2=0x7f5d841330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 --2- 172.21.15.157:0/702054063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4d10 0x7f5d841330b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5d6c002f30 tx=0x7f5d6c006e90).stop 2020-07-16T20:31:07.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 -- 172.21.15.157:0/702054063 shutdown_connections 2020-07-16T20:31:07.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 --2- 172.21.15.157:0/702054063 >> v2:172.21.15.41:3300/0 conn(0x7f5d841335a0 0x7f5d84140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 --2- 172.21.15.157:0/702054063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4d10 0x7f5d841330b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 -- 172.21.15.157:0/702054063 >> 172.21.15.157:0/702054063 conn(0x7f5d84061820 msgr2=0x7f5d8409e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 -- 172.21.15.157:0/702054063 shutdown_connections 2020-07-16T20:31:07.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.019+0000 7f5d88832700 1 -- 172.21.15.157:0/702054063 wait complete. 2020-07-16T20:31:07.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.020+0000 7f5d88832700 1 Processor -- start 2020-07-16T20:31:07.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.020+0000 7f5d88832700 1 -- start start 2020-07-16T20:31:07.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d840a4930 0x7f5d8412c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d841335a0 0x7f5d840a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.049 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d840abe00 con 0x7f5d84145c80 2020-07-16T20:31:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840ab6c0 con 0x7f5d840a4930 2020-07-16T20:31:07.050 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840ab960 con 0x7f5d841335a0 2020-07-16T20:31:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d840a4930 0x7f5d8412c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d82d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5d84145c80 0x7f5d841268d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37076/0 (socket says 172.21.15.157:37076) 2020-07-16T20:31:07.051 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d82d9d700 1 -- 172.21.15.157:0/1917644155 learned_addr learned my addr 172.21.15.157:0/1917644155 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:07.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d7bfff700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d841335a0 0x7f5d840a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 -- 172.21.15.157:0/1917644155 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d841335a0 msgr2=0x7f5d840a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.054 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d841335a0 0x7f5d840a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 -- 172.21.15.157:0/1917644155 >> v1:172.21.15.157:6789/0 conn(0x7f5d84145c80 legacy=0x7f5d841268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 -- 172.21.15.157:0/1917644155 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840aa1c0 con 0x7f5d840a4930 2020-07-16T20:31:07.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963771704 0 0) 0x7f5d7c0094e0 con 0x7f5d84145c80 2020-07-16T20:31:07.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d8259c700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4930 0x7f5d8412c380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f5d840a3a40 tx=0x7f5d74007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.056 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7400f470 con 0x7f5d840a4930 2020-07-16T20:31:07.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7400f5d0 con 0x7f5d840a4930 2020-07-16T20:31:07.057 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7400f930 con 0x7f5d840a4930 2020-07-16T20:31:07.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840a9e60 con 0x7f5d840a4930 2020-07-16T20:31:07.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.021+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d84126fe0 con 0x7f5d840a4930 2020-07-16T20:31:07.058 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.022+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d84057490 con 0x7f5d840a4930 2020-07-16T20:31:07.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.023+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5d74019030 con 0x7f5d840a4930 2020-07-16T20:31:07.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.023+0000 7f5d7a7fc700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 0x7f5d60052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.059 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.023+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5d74067050 con 0x7f5d840a4930 2020-07-16T20:31:07.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.023+0000 7f5d7bfff700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 0x7f5d60052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.060 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.023+0000 7f5d7bfff700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 0x7f5d60052320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5d6c01c000 tx=0x7f5d6c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.064 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.026+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5d7403f7e0 con 0x7f5d840a4930 2020-07-16T20:31:07.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.174+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d84043fd0 con 0x7f5d840a4930 2020-07-16T20:31:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.175+0000 7f5d7a7fc700 1 -- 172.21.15.157:0/1917644155 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f5d74042e00 con 0x7f5d840a4930 2020-07-16T20:31:07.176 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:07.176 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:31:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 msgr2=0x7f5d60052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 0x7f5d60052320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5d6c01c000 tx=0x7f5d6c015000).stop 2020-07-16T20:31:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4930 msgr2=0x7f5d8412c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4930 0x7f5d8412c380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f5d840a3a40 tx=0x7f5d74007b70).stop 2020-07-16T20:31:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 shutdown_connections 2020-07-16T20:31:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f5d6004fe60 0x7f5d60052320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d840a4930 0x7f5d8412c380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 --2- 172.21.15.157:0/1917644155 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5d841335a0 0x7f5d840a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 >> 172.21.15.157:0/1917644155 conn(0x7f5d84061820 msgr2=0x7f5d8405bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 shutdown_connections 2020-07-16T20:31:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.177+0000 7f5d88832700 1 -- 172.21.15.157:0/1917644155 wait complete. 2020-07-16T20:31:07.189 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:31:07.297 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 Processor -- start 2020-07-16T20:31:07.297 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 -- start start 2020-07-16T20:31:07.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 0x7f585409ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58540a2ed0 0x7f58540a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 0x7f58541333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.296+0000 7f58593bc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5854068260 con 0x7f58540a7290 2020-07-16T20:31:07.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5854067b20 con 0x7f58540a2ed0 2020-07-16T20:31:07.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5854067dc0 con 0x7f5854132f40 2020-07-16T20:31:07.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58540a2ed0 0x7f58540a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f58540a2ed0 0x7f58540a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34392/0 (socket says 172.21.15.157:34392) 2020-07-16T20:31:07.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 -- 172.21.15.157:0/3508733994 learned_addr learned my addr 172.21.15.157:0/3508733994 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:07.307 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5853fff700 1 --2- 172.21.15.157:0/3508733994 >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 0x7f585409ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.307 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5858bbb700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 0x7f58541333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.308 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 -- 172.21.15.157:0/3508733994 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 msgr2=0x7f58541333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:07.309 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 0x7f58541333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 -- 172.21.15.157:0/3508733994 >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 msgr2=0x7f585409ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:07.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 --2- 172.21.15.157:0/3508733994 >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 0x7f585409ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 -- 172.21.15.157:0/3508733994 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540a7670 con 0x7f58540a2ed0 2020-07-16T20:31:07.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5853fff700 1 --2- 172.21.15.157:0/3508733994 >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 0x7f585409ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:07.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5858bbb700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 0x7f58541333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:07.312 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58537fe700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540a2ed0 0x7f58540a3330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f5848002f30 tx=0x7f5848006e90).ready entity=mon.1 client_cookie=3f73a12d02e7a40a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.312 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5852ffd700 1 -- 172.21.15.157:0/3508733994 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5848009920 con 0x7f58540a2ed0 2020-07-16T20:31:07.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5852ffd700 1 -- 172.21.15.157:0/3508733994 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848009a80 con 0x7f58540a2ed0 2020-07-16T20:31:07.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f5852ffd700 1 -- 172.21.15.157:0/3508733994 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5848009de0 con 0x7f58540a2ed0 2020-07-16T20:31:07.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- 172.21.15.157:0/3508733994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540a2ed0 msgr2=0x7f58540a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540a2ed0 0x7f58540a3330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f5848002f30 tx=0x7f5848006e90).stop 2020-07-16T20:31:07.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- 172.21.15.157:0/3508733994 shutdown_connections 2020-07-16T20:31:07.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5854132f40 0x7f58541333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 --2- 172.21.15.157:0/3508733994 >> v2:172.21.15.41:3300/0 conn(0x7f58540a7290 0x7f585409ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 --2- 172.21.15.157:0/3508733994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540a2ed0 0x7f58540a3330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- 172.21.15.157:0/3508733994 >> 172.21.15.157:0/3508733994 conn(0x7f585405b810 msgr2=0x7f585405bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- 172.21.15.157:0/3508733994 shutdown_connections 2020-07-16T20:31:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.297+0000 7f58593bc700 1 -- 172.21.15.157:0/3508733994 wait complete. 2020-07-16T20:31:07.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 Processor -- start 2020-07-16T20:31:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 -- start start 2020-07-16T20:31:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5854132f40 0x7f58540a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5854136e30 0x7f585412def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5854149f10 con 0x7f58540a7290 2020-07-16T20:31:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5854138080 con 0x7f5854136e30 2020-07-16T20:31:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.299+0000 7f58593bc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5854138320 con 0x7f5854132f40 2020-07-16T20:31:07.321 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5854132f40 0x7f58540a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5854132f40 0x7f58540a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34400/0 (socket says 172.21.15.157:34400) 2020-07-16T20:31:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 -- 172.21.15.157:0/3123646558 learned_addr learned my addr 172.21.15.157:0/3123646558 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:07.322 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f5858bbb700 1 --2- 172.21.15.157:0/3123646558 >> v2:172.21.15.41:3300/0 conn(0x7f5854136e30 0x7f585412def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 -- 172.21.15.157:0/3123646558 >> v2:172.21.15.41:3300/0 conn(0x7f5854136e30 msgr2=0x7f585412def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.323 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 --2- 172.21.15.157:0/3123646558 >> v2:172.21.15.41:3300/0 conn(0x7f5854136e30 0x7f585412def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.324 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 -- 172.21.15.157:0/3123646558 >> v1:172.21.15.41:6789/0 conn(0x7f58540a7290 legacy=0x7f58540a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.324 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918449043 0 0) 0x7f5854149f10 con 0x7f58540a7290 2020-07-16T20:31:07.324 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 -- 172.21.15.157:0/3123646558 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58541385c0 con 0x7f5854132f40 2020-07-16T20:31:07.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58537fe700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854132f40 0x7f58540a18e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5848002f30 tx=0x7f5848015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584801d5d0 con 0x7f5854132f40 2020-07-16T20:31:07.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584801d730 con 0x7f5854132f40 2020-07-16T20:31:07.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58540a0dc0 con 0x7f5854132f40 2020-07-16T20:31:07.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584801da90 con 0x7f5854132f40 2020-07-16T20:31:07.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.300+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585414a620 con 0x7f5854132f40 2020-07-16T20:31:07.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.301+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5854138750 con 0x7f5854132f40 2020-07-16T20:31:07.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.301+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5848025030 con 0x7f5854132f40 2020-07-16T20:31:07.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.302+0000 7f5833fff700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 0x7f582c052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.302+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5848069410 con 0x7f5854132f40 2020-07-16T20:31:07.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.302+0000 7f5853fff700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 0x7f582c052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.302+0000 7f5853fff700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 0x7f582c052340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5844003070 tx=0x7f5844008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.305+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5848041ba0 con 0x7f5854132f40 2020-07-16T20:31:07.450 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.449+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5854057490 con 0x7f582c04fe80 2020-07-16T20:31:07.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.452+0000 7f5833fff700 1 -- 172.21.15.157:0/3123646558 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82328 (secure 0 0 0) 0x7f5854057490 con 0x7f582c04fe80 2020-07-16T20:31:07.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 msgr2=0x7f582c052340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 0x7f582c052340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5844003070 tx=0x7f5844008040).stop 2020-07-16T20:31:07.458 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854132f40 msgr2=0x7f58540a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854132f40 0x7f58540a18e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5848002f30 tx=0x7f5848015000).stop 2020-07-16T20:31:07.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 shutdown_connections 2020-07-16T20:31:07.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f582c04fe80 0x7f582c052340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 --2- 172.21.15.157:0/3123646558 >> v2:172.21.15.41:3300/0 conn(0x7f5854136e30 0x7f585412def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 --2- 172.21.15.157:0/3123646558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5854132f40 0x7f58540a18e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 >> 172.21.15.157:0/3123646558 conn(0x7f585405b810 msgr2=0x7f58540a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 shutdown_connections 2020-07-16T20:31:07.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.454+0000 7f58593bc700 1 -- 172.21.15.157:0/3123646558 wait complete. 2020-07-16T20:31:07.462 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:07.463 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2020-07-16T20:31:07.465 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2020-07-16T20:31:06.551858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":833064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002225"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934353+0000","last_change":"2020-07-16T20:30:50.929263+0000","last_active":"2020-07-16T20:30:50.934353+0000","last_peered":"2020-07-16T20:30:50.934353+0000","last_clean":"2020-07-16T20:30:50.934353+0000","last_became_active":"2020-07-16T20:30:50.928273+0000","last_became_peered":"2020-07-16T20:30:50.928273+0000","last_unstale":"2020-07-16T20:30:50.934353+0000","last_undegraded":"2020-07-16T20:30:50.934353+0000","last_fullsized":"2020-07-16T20:30:50.934353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.733535+0000","last_change":"2020-07-16T20:30:44.962204+0000","last_active":"2020-07-16T20:30:50.733535+0000","last_peered":"2020-07-16T20:30:50.733535+0000","last_clean":"2020-07-16T20:30:50.733535+0000","last_became_active":"2020-07-16T20:30:44.961763+0000","last_became_peered":"2020-07-16T20:30:44.961763+0000","last_unstale":"2020-07-16T20:30:50.733535+0000","last_undegraded":"2020-07-16T20:30:50.733535+0000","last_fullsized":"2020-07-16T20:30:50.733535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.758603+0000","last_change":"2020-07-16T20:30:47.717995+0000","last_active":"2020-07-16T20:30:53.758603+0000","last_peered":"2020-07-16T20:30:53.758603+0000","last_clean":"2020-07-16T20:30:53.758603+0000","last_became_active":"2020-07-16T20:30:47.717450+0000","last_became_peered":"2020-07-16T20:30:47.717450+0000","last_unstale":"2020-07-16T20:30:53.758603+0000","last_undegraded":"2020-07-16T20:30:53.758603+0000","last_fullsized":"2020-07-16T20:30:53.758603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934773+0000","last_change":"2020-07-16T20:30:50.930286+0000","last_active":"2020-07-16T20:30:50.934773+0000","last_peered":"2020-07-16T20:30:50.934773+0000","last_clean":"2020-07-16T20:30:50.934773+0000","last_became_active":"2020-07-16T20:30:50.929602+0000","last_became_peered":"2020-07-16T20:30:50.929602+0000","last_unstale":"2020-07-16T20:30:50.934773+0000","last_undegraded":"2020-07-16T20:30:50.934773+0000","last_fullsized":"2020-07-16T20:30:50.934773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735167+0000","last_change":"2020-07-16T20:30:44.962272+0000","last_active":"2020-07-16T20:30:50.735167+0000","last_peered":"2020-07-16T20:30:50.735167+0000","last_clean":"2020-07-16T20:30:50.735167+0000","last_became_active":"2020-07-16T20:30:44.961928+0000","last_became_peered":"2020-07-16T20:30:44.961928+0000","last_unstale":"2020-07-16T20:30:50.735167+0000","last_undegraded":"2020-07-16T20:30:50.735167+0000","last_fullsized":"2020-07-16T20:30:50.735167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.752563+0000","last_change":"2020-07-16T20:30:47.713854+0000","last_active":"2020-07-16T20:30:53.752563+0000","last_peered":"2020-07-16T20:30:53.752563+0000","last_clean":"2020-07-16T20:30:53.752563+0000","last_became_active":"2020-07-16T20:30:47.713550+0000","last_became_peered":"2020-07-16T20:30:47.713550+0000","last_unstale":"2020-07-16T20:30:53.752563+0000","last_undegraded":"2020-07-16T20:30:53.752563+0000","last_fullsized":"2020-07-16T20:30:53.752563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934332+0000","last_change":"2020-07-16T20:30:50.929119+0000","last_active":"2020-07-16T20:30:50.934332+0000","last_peered":"2020-07-16T20:30:50.934332+0000","last_clean":"2020-07-16T20:30:50.934332+0000","last_became_active":"2020-07-16T20:30:50.928367+0000","last_became_peered":"2020-07-16T20:30:50.928367+0000","last_unstale":"2020-07-16T20:30:50.934332+0000","last_undegraded":"2020-07-16T20:30:50.934332+0000","last_fullsized":"2020-07-16T20:30:50.934332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.926306+0000","last_change":"2020-07-16T20:30:44.693534+0000","last_active":"2020-07-16T20:30:50.926306+0000","last_peered":"2020-07-16T20:30:50.926306+0000","last_clean":"2020-07-16T20:30:50.926306+0000","last_became_active":"2020-07-16T20:30:44.693060+0000","last_became_peered":"2020-07-16T20:30:44.693060+0000","last_unstale":"2020-07-16T20:30:50.926306+0000","last_undegraded":"2020-07-16T20:30:50.926306+0000","last_fullsized":"2020-07-16T20:30:50.926306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761618+0000","last_change":"2020-07-16T20:30:47.969735+0000","last_active":"2020-07-16T20:30:53.761618+0000","last_peered":"2020-07-16T20:30:53.761618+0000","last_clean":"2020-07-16T20:30:53.761618+0000","last_became_active":"2020-07-16T20:30:47.969397+0000","last_became_peered":"2020-07-16T20:30:47.969397+0000","last_unstale":"2020-07-16T20:30:53.761618+0000","last_undegraded":"2020-07-16T20:30:53.761618+0000","last_fullsized":"2020-07-16T20:30:53.761618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.928282+0000","last_change":"2020-07-16T20:30:50.927407+0000","last_active":"2020-07-16T20:30:50.928282+0000","last_peered":"2020-07-16T20:30:50.928282+0000","last_clean":"2020-07-16T20:30:50.928282+0000","last_became_active":"2020-07-16T20:30:50.926714+0000","last_became_peered":"2020-07-16T20:30:50.926714+0000","last_unstale":"2020-07-16T20:30:50.928282+0000","last_undegraded":"2020-07-16T20:30:50.928282+0000","last_fullsized":"2020-07-16T20:30:50.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735228+0000","last_change":"2020-07-16T20:30:44.879472+0000","last_active":"2020-07-16T20:30:50.735228+0000","last_peered":"2020-07-16T20:30:50.735228+0000","last_clean":"2020-07-16T20:30:50.735228+0000","last_became_active":"2020-07-16T20:30:44.879044+0000","last_became_peered":"2020-07-16T20:30:44.879044+0000","last_unstale":"2020-07-16T20:30:50.735228+0000","last_undegraded":"2020-07-16T20:30:50.735228+0000","last_fullsized":"2020-07-16T20:30:50.735228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.811130+0000","last_change":"2020-07-16T20:30:39.886285+0000","last_active":"2020-07-16T20:30:50.811130+0000","last_peered":"2020-07-16T20:30:50.811130+0000","last_clean":"2020-07-16T20:30:50.811130+0000","last_became_active":"2020-07-16T20:30:39.885893+0000","last_became_peered":"2020-07-16T20:30:39.885893+0000","last_unstale":"2020-07-16T20:30:50.811130+0000","last_undegraded":"2020-07-16T20:30:50.811130+0000","last_fullsized":"2020-07-16T20:30:50.811130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_clean_scrub_stamp":"2020-07-16T20:30:32.595429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:51.531044+0000","last_change":"2020-07-16T20:30:47.717861+0000","last_active":"2020-07-16T20:30:51.531044+0000","last_peered":"2020-07-16T20:30:51.531044+0000","last_clean":"2020-07-16T20:30:51.531044+0000","last_became_active":"2020-07-16T20:30:47.717403+0000","last_became_peered":"2020-07-16T20:30:47.717403+0000","last_unstale":"2020-07-16T20:30:51.531044+0000","last_undegraded":"2020-07-16T20:30:51.531044+0000","last_fullsized":"2020-07-16T20:30:51.531044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.930822+0000","last_change":"2020-07-16T20:30:50.928755+0000","last_active":"2020-07-16T20:30:50.930822+0000","last_peered":"2020-07-16T20:30:50.930822+0000","last_clean":"2020-07-16T20:30:50.930822+0000","last_became_active":"2020-07-16T20:30:50.928124+0000","last_became_peered":"2020-07-16T20:30:50.928124+0000","last_unstale":"2020-07-16T20:30:50.930822+0000","last_undegraded":"2020-07-16T20:30:50.930822+0000","last_fullsized":"2020-07-16T20:30:50.930822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735124+0000","last_change":"2020-07-16T20:30:44.695156+0000","last_active":"2020-07-16T20:30:50.735124+0000","last_peered":"2020-07-16T20:30:50.735124+0000","last_clean":"2020-07-16T20:30:50.735124+0000","last_became_active":"2020-07-16T20:30:44.694873+0000","last_became_peered":"2020-07-16T20:30:44.694873+0000","last_unstale":"2020-07-16T20:30:50.735124+0000","last_undegraded":"2020-07-16T20:30:50.735124+0000","last_fullsized":"2020-07-16T20:30:50.735124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734862+0000","last_change":"2020-07-16T20:30:47.716604+0000","last_active":"2020-07-16T20:30:50.734862+0000","last_peered":"2020-07-16T20:30:50.734862+0000","last_clean":"2020-07-16T20:30:50.734862+0000","last_became_active":"2020-07-16T20:30:47.716172+0000","last_became_peered":"2020-07-16T20:30:47.716172+0000","last_unstale":"2020-07-16T20:30:50.734862+0000","last_undegraded":"2020-07-16T20:30:50.734862+0000","last_fullsized":"2020-07-16T20:30:50.734862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934749+0000","last_change":"2020-07-16T20:30:50.929889+0000","last_active":"2020-07-16T20:30:50.934749+0000","last_peered":"2020-07-16T20:30:50.934749+0000","last_clean":"2020-07-16T20:30:50.934749+0000","last_became_active":"2020-07-16T20:30:50.929189+0000","last_became_peered":"2020-07-16T20:30:50.929189+0000","last_unstale":"2020-07-16T20:30:50.934749+0000","last_undegraded":"2020-07-16T20:30:50.934749+0000","last_fullsized":"2020-07-16T20:30:50.934749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735992+0000","last_change":"2020-07-16T20:30:44.695179+0000","last_active":"2020-07-16T20:30:50.735992+0000","last_peered":"2020-07-16T20:30:50.735992+0000","last_clean":"2020-07-16T20:30:50.735992+0000","last_became_active":"2020-07-16T20:30:44.694857+0000","last_became_peered":"2020-07-16T20:30:44.694857+0000","last_unstale":"2020-07-16T20:30:50.735992+0000","last_undegraded":"2020-07-16T20:30:50.735992+0000","last_fullsized":"2020-07-16T20:30:50.735992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761507+0000","last_change":"2020-07-16T20:30:47.719857+0000","last_active":"2020-07-16T20:30:53.761507+0000","last_peered":"2020-07-16T20:30:53.761507+0000","last_clean":"2020-07-16T20:30:53.761507+0000","last_became_active":"2020-07-16T20:30:47.719440+0000","last_became_peered":"2020-07-16T20:30:47.719440+0000","last_unstale":"2020-07-16T20:30:53.761507+0000","last_undegraded":"2020-07-16T20:30:53.761507+0000","last_fullsized":"2020-07-16T20:30:53.761507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.816507+0000","last_change":"2020-07-16T20:30:50.813452+0000","last_active":"2020-07-16T20:30:50.816507+0000","last_peered":"2020-07-16T20:30:50.816507+0000","last_clean":"2020-07-16T20:30:50.816507+0000","last_became_active":"2020-07-16T20:30:50.812786+0000","last_became_peered":"2020-07-16T20:30:50.812786+0000","last_unstale":"2020-07-16T20:30:50.816507+0000","last_undegraded":"2020-07-16T20:30:50.816507+0000","last_fullsized":"2020-07-16T20:30:50.816507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.759108+0000","last_change":"2020-07-16T20:30:47.718207+0000","last_active":"2020-07-16T20:30:53.759108+0000","last_peered":"2020-07-16T20:30:53.759108+0000","last_clean":"2020-07-16T20:30:53.759108+0000","last_became_active":"2020-07-16T20:30:47.717750+0000","last_became_peered":"2020-07-16T20:30:47.717750+0000","last_unstale":"2020-07-16T20:30:53.759108+0000","last_undegraded":"2020-07-16T20:30:53.759108+0000","last_fullsized":"2020-07-16T20:30:53.759108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734870+0000","last_change":"2020-07-16T20:30:44.728373+0000","last_active":"2020-07-16T20:30:50.734870+0000","last_peered":"2020-07-16T20:30:50.734870+0000","last_clean":"2020-07-16T20:30:50.734870+0000","last_became_active":"2020-07-16T20:30:44.727914+0000","last_became_peered":"2020-07-16T20:30:44.727914+0000","last_unstale":"2020-07-16T20:30:50.734870+0000","last_undegraded":"2020-07-16T20:30:50.734870+0000","last_fullsized":"2020-07-16T20:30:50.734870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.814909+0000","last_change":"2020-07-16T20:30:50.814285+0000","last_active":"2020-07-16T20:30:50.814909+0000","last_peered":"2020-07-16T20:30:50.814909+0000","last_clean":"2020-07-16T20:30:50.814909+0000","last_became_active":"2020-07-16T20:30:50.812831+0000","last_became_peered":"2020-07-16T20:30:50.812831+0000","last_unstale":"2020-07-16T20:30:50.814909+0000","last_undegraded":"2020-07-16T20:30:50.814909+0000","last_fullsized":"2020-07-16T20:30:50.814909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735926+0000","last_change":"2020-07-16T20:30:44.727996+0000","last_active":"2020-07-16T20:30:50.735926+0000","last_peered":"2020-07-16T20:30:50.735926+0000","last_clean":"2020-07-16T20:30:50.735926+0000","last_became_active":"2020-07-16T20:30:44.727593+0000","last_became_peered":"2020-07-16T20:30:44.727593+0000","last_unstale":"2020-07-16T20:30:50.735926+0000","last_undegraded":"2020-07-16T20:30:50.735926+0000","last_fullsized":"2020-07-16T20:30:50.735926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.756760+0000","last_change":"2020-07-16T20:30:47.969976+0000","last_active":"2020-07-16T20:30:53.756760+0000","last_peered":"2020-07-16T20:30:53.756760+0000","last_clean":"2020-07-16T20:30:53.756760+0000","last_became_active":"2020-07-16T20:30:47.969384+0000","last_became_peered":"2020-07-16T20:30:47.969384+0000","last_unstale":"2020-07-16T20:30:53.756760+0000","last_undegraded":"2020-07-16T20:30:53.756760+0000","last_fullsized":"2020-07-16T20:30:53.756760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":105092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]}]}} 2020-07-16T20:31:07.468 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:31:07.576 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.576+0000 7f9913614700 1 Processor -- start 2020-07-16T20:31:07.577 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.576+0000 7f9913614700 1 -- start start 2020-07-16T20:31:07.584 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a48e0 0x7f990c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a7fb0 0x7f990c0a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c0a5450 con 0x7f990c0ab780 2020-07-16T20:31:07.585 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0a7880 con 0x7f990c0a48e0 2020-07-16T20:31:07.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a8930 con 0x7f990c0a7fb0 2020-07-16T20:31:07.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a48e0 0x7f990c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a48e0 0x7f990c0a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34406/0 (socket says 172.21.15.157:34406) 2020-07-16T20:31:07.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 -- 172.21.15.157:0/521784572 learned_addr learned my addr 172.21.15.157:0/521784572 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:07.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9910baf700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a7fb0 0x7f990c0a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.587 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 -- 172.21.15.157:0/521784572 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a7fb0 msgr2=0x7f990c0a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:07.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a7fb0 0x7f990c0a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 -- 172.21.15.157:0/521784572 >> v1:172.21.15.41:6789/0 conn(0x7f990c0ab780 legacy=0x7f990c0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:07.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 -- 172.21.15.157:0/521784572 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0a56b0 con 0x7f990c0a48e0 2020-07-16T20:31:07.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f99113b0700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a48e0 0x7f990c0a4cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f990c0601d0 tx=0x7f9900006e90).ready entity=mon.1 client_cookie=e38e3e6891113f42 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f98fffff700 1 -- 172.21.15.157:0/521784572 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99000098e0 con 0x7f990c0a48e0 2020-07-16T20:31:07.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f98fffff700 1 -- 172.21.15.157:0/521784572 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9900009a40 con 0x7f990c0a48e0 2020-07-16T20:31:07.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f98fffff700 1 -- 172.21.15.157:0/521784572 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9900009de0 con 0x7f990c0a48e0 2020-07-16T20:31:07.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- 172.21.15.157:0/521784572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a48e0 msgr2=0x7f990c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a48e0 0x7f990c0a4cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f990c0601d0 tx=0x7f9900006e90).stop 2020-07-16T20:31:07.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- 172.21.15.157:0/521784572 shutdown_connections 2020-07-16T20:31:07.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a48e0 0x7f990c0a4cc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 --2- 172.21.15.157:0/521784572 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a7fb0 0x7f990c0a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.577+0000 7f9913614700 1 -- 172.21.15.157:0/521784572 >> 172.21.15.157:0/521784572 conn(0x7f990c061820 msgr2=0x7f990c09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.578+0000 7f9913614700 1 -- 172.21.15.157:0/521784572 shutdown_connections 2020-07-16T20:31:07.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.578+0000 7f9913614700 1 -- 172.21.15.157:0/521784572 wait complete. 2020-07-16T20:31:07.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.579+0000 7f9913614700 1 Processor -- start 2020-07-16T20:31:07.595 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.579+0000 7f9913614700 1 -- start start 2020-07-16T20:31:07.596 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a7fb0 0x7f990c126ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.596 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 0x7f990c134060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c12fa50 con 0x7f990c0ab780 2020-07-16T20:31:07.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c136010 con 0x7f990c0a7fb0 2020-07-16T20:31:07.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c12fcf0 con 0x7f990c0a2460 2020-07-16T20:31:07.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a7fb0 0x7f990c126ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f990c0a7fb0 0x7f990c126ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34412/0 (socket says 172.21.15.157:34412) 2020-07-16T20:31:07.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 -- 172.21.15.157:0/1333713482 learned_addr learned my addr 172.21.15.157:0/1333713482 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:07.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9911bb1700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 0x7f990c134060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 -- 172.21.15.157:0/1333713482 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 msgr2=0x7f990c134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 0x7f990c134060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 -- 172.21.15.157:0/1333713482 >> v1:172.21.15.41:6789/0 conn(0x7f990c0ab780 legacy=0x7f990c125480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 -- 172.21.15.157:0/1333713482 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c135c90 con 0x7f990c0a7fb0 2020-07-16T20:31:07.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9911bb1700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 0x7f990c134060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:07.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f99113b0700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a7fb0 0x7f990c126ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f990c125210 tx=0x7f9900015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9900009e80 con 0x7f990c0a7fb0 2020-07-16T20:31:07.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990001d5d0 con 0x7f990c0a7fb0 2020-07-16T20:31:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c127cc0 con 0x7f990c0a7fb0 2020-07-16T20:31:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990001d930 con 0x7f990c0a7fb0 2020-07-16T20:31:07.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.580+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c134790 con 0x7f990c0a7fb0 2020-07-16T20:31:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.581+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c135e80 con 0x7f990c0a7fb0 2020-07-16T20:31:07.604 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.581+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f9900025030 con 0x7f990c0a7fb0 2020-07-16T20:31:07.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.582+0000 7f98fd7fa700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 0x7f98e4052430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:07.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.582+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f99000695b0 con 0x7f990c0a7fb0 2020-07-16T20:31:07.605 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.582+0000 7f9910baf700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 0x7f98e4052430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:07.606 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.582+0000 7f9910baf700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 0x7f98e4052430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f990c126c90 tx=0x7f9908008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:07.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.585+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f9900041d40 con 0x7f990c0a7fb0 2020-07-16T20:31:07.731 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.731+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f990c057490 con 0x7f990c0a7fb0 2020-07-16T20:31:07.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.732+0000 7f98fd7fa700 1 -- 172.21.15.157:0/1333713482 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f9900045360 con 0x7f990c0a7fb0 2020-07-16T20:31:07.733 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:07.733 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":24,"fsid":"cfd2f8dd-09bb-4e6b-8709-0ded1adfce51","created":"2020-07-16T20:30:29.331370+0000","modified":"2020-07-16T20:30:51.081630+0000","last_up_change":"2020-07-16T20:30:38.568209+0000","last_in_change":"2020-07-16T20:30:38.568209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:32.588806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:42.750526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:46.151313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:48.751540+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"400d38af-3da6-4811-83e9-181b7a079aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":23737},{"type":"v1","addr":"172.21.15.157:6803","nonce":23737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":23737},{"type":"v1","addr":"172.21.15.157:6805","nonce":23737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":23737},{"type":"v1","addr":"172.21.15.157:6809","nonce":23737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":23737},{"type":"v1","addr":"172.21.15.157:6807","nonce":23737}]},"public_addr":"172.21.15.157:6803/23737","cluster_addr":"172.21.15.157:6805/23737","heartbeat_back_addr":"172.21.15.157:6809/23737","heartbeat_front_addr":"172.21.15.157:6807/23737","state":["exists","up"]},{"osd":1,"uuid":"e326ac35-938c-4db2-b98e-59c797611374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":23739},{"type":"v1","addr":"172.21.15.157:6819","nonce":23739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":23739},{"type":"v1","addr":"172.21.15.157:6821","nonce":23739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":23739},{"type":"v1","addr":"172.21.15.157:6825","nonce":23739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":23739},{"type":"v1","addr":"172.21.15.157:6823","nonce":23739}]},"public_addr":"172.21.15.157:6819/23739","cluster_addr":"172.21.15.157:6821/23739","heartbeat_back_addr":"172.21.15.157:6825/23739","heartbeat_front_addr":"172.21.15.157:6823/23739","state":["exists","up"]},{"osd":2,"uuid":"7340b5ba-43d8-4772-8679-9b2aced5930c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":23738},{"type":"v1","addr":"172.21.15.157:6811","nonce":23738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":23738},{"type":"v1","addr":"172.21.15.157:6813","nonce":23738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":23738},{"type":"v1","addr":"172.21.15.157:6817","nonce":23738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":23738},{"type":"v1","addr":"172.21.15.157:6815","nonce":23738}]},"public_addr":"172.21.15.157:6811/23738","cluster_addr":"172.21.15.157:6813/23738","heartbeat_back_addr":"172.21.15.157:6817/23738","heartbeat_front_addr":"172.21.15.157:6815/23738","state":["exists","up"]},{"osd":3,"uuid":"f9aa3b98-7cdf-481f-9e9b-86808c472d1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":23750},{"type":"v1","addr":"172.21.15.157:6827","nonce":23750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":23750},{"type":"v1","addr":"172.21.15.157:6829","nonce":23750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":23750},{"type":"v1","addr":"172.21.15.157:6833","nonce":23750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":23750},{"type":"v1","addr":"172.21.15.157:6831","nonce":23750}]},"public_addr":"172.21.15.157:6827/23750","cluster_addr":"172.21.15.157:6829/23750","heartbeat_back_addr":"172.21.15.157:6833/23750","heartbeat_front_addr":"172.21.15.157:6831/23750","state":["exists","up"]},{"osd":4,"uuid":"6e7a96a6-e79d-40b8-b094-31ff6a9f7a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":23935},{"type":"v1","addr":"172.21.15.41:6801","nonce":23935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":23935},{"type":"v1","addr":"172.21.15.41:6803","nonce":23935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":23935},{"type":"v1","addr":"172.21.15.41:6807","nonce":23935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":23935},{"type":"v1","addr":"172.21.15.41:6805","nonce":23935}]},"public_addr":"172.21.15.41:6801/23935","cluster_addr":"172.21.15.41:6803/23935","heartbeat_back_addr":"172.21.15.41:6807/23935","heartbeat_front_addr":"172.21.15.41:6805/23935","state":["exists","up"]},{"osd":5,"uuid":"d9925dee-95e0-4346-b7b9-e0cf396e8538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":23951},{"type":"v1","addr":"172.21.15.41:6818","nonce":23951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":23951},{"type":"v1","addr":"172.21.15.41:6822","nonce":23951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":23951},{"type":"v1","addr":"172.21.15.41:6830","nonce":23951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6824","nonce":23951},{"type":"v1","addr":"172.21.15.41:6827","nonce":23951}]},"public_addr":"172.21.15.41:6818/23951","cluster_addr":"172.21.15.41:6822/23951","heartbeat_back_addr":"172.21.15.41:6830/23951","heartbeat_front_addr":"172.21.15.41:6827/23951","state":["exists","up"]},{"osd":6,"uuid":"778458a4-92c9-4394-b239-d95ac82ca4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":23936},{"type":"v1","addr":"172.21.15.41:6809","nonce":23936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":23936},{"type":"v1","addr":"172.21.15.41:6811","nonce":23936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":23936},{"type":"v1","addr":"172.21.15.41:6815","nonce":23936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":23936},{"type":"v1","addr":"172.21.15.41:6813","nonce":23936}]},"public_addr":"172.21.15.41:6809/23936","cluster_addr":"172.21.15.41:6811/23936","heartbeat_back_addr":"172.21.15.41:6815/23936","heartbeat_front_addr":"172.21.15.41:6813/23936","state":["exists","up"]},{"osd":7,"uuid":"2b74b7ca-1708-4096-8c95-c9eebefddf1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6817","nonce":23952},{"type":"v1","addr":"172.21.15.41:6819","nonce":23952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6821","nonce":23952},{"type":"v1","addr":"172.21.15.41:6823","nonce":23952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6829","nonce":23952},{"type":"v1","addr":"172.21.15.41:6831","nonce":23952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6825","nonce":23952},{"type":"v1","addr":"172.21.15.41:6826","nonce":23952}]},"public_addr":"172.21.15.41:6819/23952","cluster_addr":"172.21.15.41:6823/23952","heartbeat_back_addr":"172.21.15.41:6831/23952","heartbeat_front_addr":"172.21.15.41:6826/23952","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.918328+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.917232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.896030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.912552+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.895148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.964772+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.969035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:36.993263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:31:07.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 msgr2=0x7f98e4052430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 0x7f98e4052430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f990c126c90 tx=0x7f9908008040).stop 2020-07-16T20:31:07.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a7fb0 msgr2=0x7f990c126ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:07.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a7fb0 0x7f990c126ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f990c125210 tx=0x7f9900015000).stop 2020-07-16T20:31:07.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 shutdown_connections 2020-07-16T20:31:07.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f98e404ff70 0x7f98e4052430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f990c0a2460 0x7f990c134060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 --2- 172.21.15.157:0/1333713482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c0a7fb0 0x7f990c126ec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:07.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 >> 172.21.15.157:0/1333713482 conn(0x7f990c061820 msgr2=0x7f990c09e870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:07.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 shutdown_connections 2020-07-16T20:31:07.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:07.733+0000 7f9913614700 1 -- 172.21.15.157:0/1333713482 wait complete. 2020-07-16T20:31:08.745 INFO:tasks.ceph:Scrubbing osd.0 2020-07-16T20:31:08.746 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:08.867 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.866+0000 7f98bc16b700 1 Processor -- start 2020-07-16T20:31:08.867 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 -- start start 2020-07-16T20:31:08.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b4133a80 0x7f98b40a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b40a8800 0x7f98b4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.870 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40a4710 con 0x7f98b40a7470 2020-07-16T20:31:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40a5c00 con 0x7f98b40a8800 2020-07-16T20:31:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98bc16b700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40a9110 con 0x7f98b4133a80 2020-07-16T20:31:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98ba708700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b40a8800 0x7f98b4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98ba708700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b40a8800 0x7f98b4140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34422/0 (socket says 172.21.15.157:34422) 2020-07-16T20:31:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98ba708700 1 -- 172.21.15.157:0/2974035137 learned_addr learned my addr 172.21.15.157:0/2974035137 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.867+0000 7f98b9f07700 1 --1- 172.21.15.157:0/2974035137 >> v1:172.21.15.157:6789/0 conn(0x7f98b40a7470 0x7f98b4133370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37108/0 (socket says 172.21.15.157:37108) 2020-07-16T20:31:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98b9706700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b4133a80 0x7f98b40a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.872 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98ba708700 1 -- 172.21.15.157:0/2974035137 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b4133a80 msgr2=0x7f98b40a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98ba708700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b4133a80 0x7f98b40a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98ba708700 1 -- 172.21.15.157:0/2974035137 >> v1:172.21.15.157:6789/0 conn(0x7f98b40a7470 legacy=0x7f98b4133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98b8f05700 1 -- 172.21.15.157:0/2974035137 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743680725 0 0) 0x7f98b40a4710 con 0x7f98b40a7470 2020-07-16T20:31:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98ba708700 1 -- 172.21.15.157:0/2974035137 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40a4cc0 con 0x7f98b40a8800 2020-07-16T20:31:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98ba708700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b40a8800 0x7f98b4140be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f98ac0032b0 tx=0x7f98ac009270).ready entity=mon.1 client_cookie=22d826f82e6cd2ba server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98b8f05700 1 -- 172.21.15.157:0/2974035137 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac00bc00 con 0x7f98b40a8800 2020-07-16T20:31:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98b8f05700 1 -- 172.21.15.157:0/2974035137 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00bd60 con 0x7f98b40a8800 2020-07-16T20:31:08.874 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98b8f05700 1 -- 172.21.15.157:0/2974035137 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac011400 con 0x7f98b40a8800 2020-07-16T20:31:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 -- 172.21.15.157:0/2974035137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b40a8800 msgr2=0x7f98b4140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b40a8800 0x7f98b4140be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f98ac0032b0 tx=0x7f98ac009270).stop 2020-07-16T20:31:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 -- 172.21.15.157:0/2974035137 shutdown_connections 2020-07-16T20:31:08.875 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b40a8800 0x7f98b4140be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 --2- 172.21.15.157:0/2974035137 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b4133a80 0x7f98b40a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 -- 172.21.15.157:0/2974035137 >> 172.21.15.157:0/2974035137 conn(0x7f98b409e7e0 msgr2=0x7f98b409ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:08.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 -- 172.21.15.157:0/2974035137 shutdown_connections 2020-07-16T20:31:08.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.868+0000 7f98bc16b700 1 -- 172.21.15.157:0/2974035137 wait complete. 2020-07-16T20:31:08.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 Processor -- start 2020-07-16T20:31:08.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 -- start start 2020-07-16T20:31:08.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b40a7470 0x7f98b4132700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b4133a80 0x7f98b4129400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98b41298f0 0x7f98b41280c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b412d050 con 0x7f98b41298f0 2020-07-16T20:31:08.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40aa060 con 0x7f98b4133a80 2020-07-16T20:31:08.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98bc16b700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40aa300 con 0x7f98b40a7470 2020-07-16T20:31:08.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98b9706700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b4133a80 0x7f98b4129400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98b9706700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98b4133a80 0x7f98b4129400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34428/0 (socket says 172.21.15.157:34428) 2020-07-16T20:31:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98b9706700 1 -- 172.21.15.157:0/1386026360 learned_addr learned my addr 172.21.15.157:0/1386026360 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98b9f07700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b40a7470 0x7f98b4132700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.884 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.870+0000 7f98ba708700 1 --2- 172.21.15.157:0/1386026360 >> v2:172.21.15.41:3300/0 conn(0x7f98b41298f0 0x7f98b41280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 -- 172.21.15.157:0/1386026360 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b40a7470 msgr2=0x7f98b4132700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f98b40a7470 0x7f98b4132700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.885 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 -- 172.21.15.157:0/1386026360 >> v2:172.21.15.41:3300/0 conn(0x7f98b41298f0 msgr2=0x7f98b41280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 --2- 172.21.15.157:0/1386026360 >> v2:172.21.15.41:3300/0 conn(0x7f98b41298f0 0x7f98b41280c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 -- 172.21.15.157:0/1386026360 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40aa5a0 con 0x7f98b4133a80 2020-07-16T20:31:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98ba708700 1 --2- 172.21.15.157:0/1386026360 >> v2:172.21.15.41:3300/0 conn(0x7f98b41298f0 0x7f98b41280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98b9706700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b4133a80 0x7f98b4129400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f98b000a000 tx=0x7f98b0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:08.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b0011780 con 0x7f98b4133a80 2020-07-16T20:31:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b00118e0 con 0x7f98b4133a80 2020-07-16T20:31:08.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b41285b0 con 0x7f98b4133a80 2020-07-16T20:31:08.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b0011c40 con 0x7f98b4133a80 2020-07-16T20:31:08.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.871+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b412bb00 con 0x7f98b4133a80 2020-07-16T20:31:08.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b4057490 con 0x7f98b4133a80 2020-07-16T20:31:08.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f98b001c460 con 0x7f98b4133a80 2020-07-16T20:31:08.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98a1ffb700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f988c04ffd0 0x7f988c052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.890 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f98b0068090 con 0x7f98b4133a80 2020-07-16T20:31:08.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98b9f07700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f988c04ffd0 0x7f988c052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.872+0000 7f98a1ffb700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f988c057c40 0x7f988c05a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:08.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.873+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 --> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f988c05a6b0 con 0x7f988c057c40 2020-07-16T20:31:08.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.873+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98b006a700 con 0x7f98b4133a80 2020-07-16T20:31:08.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.873+0000 7f98b9f07700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f988c04ffd0 0x7f988c052490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f98a400d000 tx=0x7f98a40079e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:08.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.873+0000 7f98ba708700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f988c057c40 0x7f988c05a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:08.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.873+0000 7f98ba708700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f988c057c40 0x7f988c05a060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:08.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.874+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== osd.0 v2:172.21.15.157:6802/23737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f988c05a6b0 con 0x7f988c057c40 2020-07-16T20:31:08.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.890+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 --> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98b40aa7a0 con 0x7f988c057c40 2020-07-16T20:31:08.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98a1ffb700 1 -- 172.21.15.157:0/1386026360 <== osd.0 v2:172.21.15.157:6802/23737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f98ac00bed0 con 0x7f988c057c40 2020-07-16T20:31:08.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f988c057c40 msgr2=0x7f988c05a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6802/23737,v1:172.21.15.157:6803/23737] conn(0x7f988c057c40 0x7f988c05a060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f988c04ffd0 msgr2=0x7f988c052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f988c04ffd0 0x7f988c052490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f98a400d000 tx=0x7f98a40079e0).stop 2020-07-16T20:31:08.898 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b4133a80 msgr2=0x7f98b4129400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:08.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b4133a80 0x7f98b4129400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f98b000a000 tx=0x7f98b0008040).stop 2020-07-16T20:31:08.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98ba708700 1 -- 172.21.15.157:0/1386026360 reap_dead start 2020-07-16T20:31:08.899 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 shutdown_connections 2020-07-16T20:31:08.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 --2- 172.21.15.157:0/1386026360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98b4133a80 0x7f98b4129400 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:08.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 >> 172.21.15.157:0/1386026360 conn(0x7f98b409e7e0 msgr2=0x7f98b409ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:08.900 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 shutdown_connections 2020-07-16T20:31:08.901 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:08.891+0000 7f98bc16b700 1 -- 172.21.15.157:0/1386026360 wait complete. 2020-07-16T20:31:08.901 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:08.902 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:08.902 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:08.904 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2020-07-16T20:31:09.011 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 Processor -- start 2020-07-16T20:31:09.012 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 -- start start 2020-07-16T20:31:09.026 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa618132860 0x7fa618132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.026 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.027 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180a3d00 con 0x7fa6180ac240 2020-07-16T20:31:09.027 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180a4130 con 0x7fa61813e260 2020-07-16T20:31:09.028 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.011+0000 7fa62037e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180a6ce0 con 0x7fa618132860 2020-07-16T20:31:09.028 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa618132860 0x7fa618132cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.028 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61e11a700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa6180ac240 0x7fa618135900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37124/0 (socket says 172.21.15.157:37124) 2020-07-16T20:31:09.029 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61e11a700 1 -- 172.21.15.157:0/4207527104 learned_addr learned my addr 172.21.15.157:0/4207527104 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:09.029 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61e91b700 1 --2- 172.21.15.157:0/4207527104 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.030 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 -- 172.21.15.157:0/4207527104 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 msgr2=0x7fa618140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.030 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 --2- 172.21.15.157:0/4207527104 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.030 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 -- 172.21.15.157:0/4207527104 >> v1:172.21.15.157:6789/0 conn(0x7fa6180ac240 legacy=0x7fa618135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.031 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 -- 172.21.15.157:0/4207527104 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180a4320 con 0x7fa618132860 2020-07-16T20:31:09.031 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d118700 1 -- 172.21.15.157:0/4207527104 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071797403 0 0) 0x7fa6180a3d00 con 0x7fa6180ac240 2020-07-16T20:31:09.031 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d919700 1 --2- 172.21.15.157:0/4207527104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa618132860 0x7fa618132cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fa60c002f30 tx=0x7fa60c006dd0).ready entity=mon.1 client_cookie=ce09101131dabbbe server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.032 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d118700 1 -- 172.21.15.157:0/4207527104 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa60c0097b0 con 0x7fa618132860 2020-07-16T20:31:09.032 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d118700 1 -- 172.21.15.157:0/4207527104 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c009910 con 0x7fa618132860 2020-07-16T20:31:09.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa61d118700 1 -- 172.21.15.157:0/4207527104 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa60c009c70 con 0x7fa618132860 2020-07-16T20:31:09.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 -- 172.21.15.157:0/4207527104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa618132860 msgr2=0x7fa618132cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 --2- 172.21.15.157:0/4207527104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa618132860 0x7fa618132cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fa60c002f30 tx=0x7fa60c006dd0).stop 2020-07-16T20:31:09.034 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 -- 172.21.15.157:0/4207527104 shutdown_connections 2020-07-16T20:31:09.034 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 --2- 172.21.15.157:0/4207527104 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.035 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 --2- 172.21.15.157:0/4207527104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa618132860 0x7fa618132cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.035 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 -- 172.21.15.157:0/4207527104 >> 172.21.15.157:0/4207527104 conn(0x7fa618061820 msgr2=0x7fa61809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 -- 172.21.15.157:0/4207527104 shutdown_connections 2020-07-16T20:31:09.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.012+0000 7fa62037e700 1 -- 172.21.15.157:0/4207527104 wait complete. 2020-07-16T20:31:09.037 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 Processor -- start 2020-07-16T20:31:09.037 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 -- start start 2020-07-16T20:31:09.037 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fa6180ac240 0x7fa6181317a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618128d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa61814a840 0x7fa61814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618133ba0 con 0x7fa61813e260 2020-07-16T20:31:09.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61814b1e0 con 0x7fa61814a840 2020-07-16T20:31:09.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa62037e700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6181349f0 con 0x7fa6180ac240 2020-07-16T20:31:09.040 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa61e91b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa61814a840 0x7fa61814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.040 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa61e91b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa61814a840 0x7fa61814acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34446/0 (socket says 172.21.15.157:34446) 2020-07-16T20:31:09.040 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa61e91b700 1 -- 172.21.15.157:0/4284211005 learned_addr learned my addr 172.21.15.157:0/4284211005 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.041 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa61e11a700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fa6180ac240 0x7fa6181317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.041 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.014+0000 7fa61d919700 1 --2- 172.21.15.157:0/4284211005 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618128d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.042 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 -- 172.21.15.157:0/4284211005 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fa6180ac240 msgr2=0x7fa6181317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.042 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fa6180ac240 0x7fa6181317a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.042 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 -- 172.21.15.157:0/4284211005 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 msgr2=0x7fa618128d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.043 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 --2- 172.21.15.157:0/4284211005 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618128d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.043 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 -- 172.21.15.157:0/4284211005 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618134c90 con 0x7fa61814a840 2020-07-16T20:31:09.043 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa61e91b700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa61814a840 0x7fa61814acf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa610006de0 tx=0x7fa6100091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.044 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61000c950 con 0x7fa61814a840 2020-07-16T20:31:09.044 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000cab0 con 0x7fa61814a840 2020-07-16T20:31:09.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61812afa0 con 0x7fa61814a840 2020-07-16T20:31:09.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61000ce10 con 0x7fa61814a840 2020-07-16T20:31:09.045 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.015+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa618129280 con 0x7fa61814a840 2020-07-16T20:31:09.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.016+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61813e640 con 0x7fa61814a840 2020-07-16T20:31:09.046 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.016+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa610022070 con 0x7fa61814a840 2020-07-16T20:31:09.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.016+0000 7fa60a7fc700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 0x7fa5f0052460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.016+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa6100682c0 con 0x7fa61814a840 2020-07-16T20:31:09.047 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.016+0000 7fa61e11a700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 0x7fa5f0052460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.017+0000 7fa61e11a700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 0x7fa5f0052460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa61400d000 tx=0x7fa614007920).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.048 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.019+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa610040a50 con 0x7fa61814a840 2020-07-16T20:31:09.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.171+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa618057490 con 0x7fa5f004ffa0 2020-07-16T20:31:09.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.172+0000 7fa60a7fc700 1 -- 172.21.15.157:0/4284211005 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa618057490 con 0x7fa5f004ffa0 2020-07-16T20:31:09.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 msgr2=0x7fa5f0052460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 0x7fa5f0052460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa61400d000 tx=0x7fa614007920).stop 2020-07-16T20:31:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa61814a840 msgr2=0x7fa61814acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa61814a840 0x7fa61814acf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa610006de0 tx=0x7fa6100091d0).stop 2020-07-16T20:31:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 shutdown_connections 2020-07-16T20:31:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fa5f004ffa0 0x7fa5f0052460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fa6180ac240 0x7fa6181317a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa61814a840 0x7fa61814acf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 --2- 172.21.15.157:0/4284211005 >> v2:172.21.15.41:3300/0 conn(0x7fa61813e260 0x7fa618128d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 >> 172.21.15.157:0/4284211005 conn(0x7fa618061820 msgr2=0x7fa61805bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 shutdown_connections 2020-07-16T20:31:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.173+0000 7fa62037e700 1 -- 172.21.15.157:0/4284211005 wait complete. 2020-07-16T20:31:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 0 to deep-scrub 2020-07-16T20:31:09.184 INFO:tasks.ceph:Scrubbing osd.1 2020-07-16T20:31:09.185 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:09.295 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.294+0000 7fdff6cc2700 1 Processor -- start 2020-07-16T20:31:09.295 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.294+0000 7fdff6cc2700 1 -- start start 2020-07-16T20:31:09.298 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 0x7fdff0133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.298 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 0x7fdff00a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.299 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdff00a8800 0x7fdff0139840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.299 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff0133cc0 con 0x7fdff0133860 2020-07-16T20:31:09.299 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00a4710 con 0x7fdff00a8800 2020-07-16T20:31:09.299 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff6cc2700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00a5c00 con 0x7fdff00a7470 2020-07-16T20:31:09.300 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff525f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdff00a8800 0x7fdff0139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.300 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff525f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdff00a8800 0x7fdff0139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34450/0 (socket says 172.21.15.157:34450) 2020-07-16T20:31:09.300 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff525f700 1 -- 172.21.15.157:0/3543329542 learned_addr learned my addr 172.21.15.157:0/3543329542 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.300 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdff4a5e700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 0x7fdff0133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.300 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.295+0000 7fdfeffff700 1 --2- 172.21.15.157:0/3543329542 >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 0x7fdff00a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.301 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 -- 172.21.15.157:0/3543329542 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 msgr2=0x7fdff0133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.301 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 0x7fdff0133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.301 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 -- 172.21.15.157:0/3543329542 >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 msgr2=0x7fdff00a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.301 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 --2- 172.21.15.157:0/3543329542 >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 0x7fdff00a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.302 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 -- 172.21.15.157:0/3543329542 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00a9110 con 0x7fdff00a8800 2020-07-16T20:31:09.302 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdfeffff700 1 --2- 172.21.15.157:0/3543329542 >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 0x7fdff00a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.302 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff4a5e700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 0x7fdff0133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.302 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff525f700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdff00a8800 0x7fdff0139840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fdfe80032b0 tx=0x7fdfe8009270).ready entity=mon.1 client_cookie=a5896497a8335148 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.302 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdfef7fe700 1 -- 172.21.15.157:0/3543329542 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe800bdf0 con 0x7fdff00a8800 2020-07-16T20:31:09.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdfef7fe700 1 -- 172.21.15.157:0/3543329542 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8010470 con 0x7fdff00a8800 2020-07-16T20:31:09.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdfef7fe700 1 -- 172.21.15.157:0/3543329542 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe80107d0 con 0x7fdff00a8800 2020-07-16T20:31:09.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 -- 172.21.15.157:0/3543329542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdff00a8800 msgr2=0x7fdff0139840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.303 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdff00a8800 0x7fdff0139840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fdfe80032b0 tx=0x7fdfe8009270).stop 2020-07-16T20:31:09.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 -- 172.21.15.157:0/3543329542 shutdown_connections 2020-07-16T20:31:09.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdff00a7470 0x7fdff0133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/3543329542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdff00a8800 0x7fdff0139840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/3543329542 >> v2:172.21.15.41:3300/0 conn(0x7fdff0133860 0x7fdff00a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.304 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 -- 172.21.15.157:0/3543329542 >> 172.21.15.157:0/3543329542 conn(0x7fdff009e7e0 msgr2=0x7fdff009ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 -- 172.21.15.157:0/3543329542 shutdown_connections 2020-07-16T20:31:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.296+0000 7fdff6cc2700 1 -- 172.21.15.157:0/3543329542 wait complete. 2020-07-16T20:31:09.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.297+0000 7fdff6cc2700 1 Processor -- start 2020-07-16T20:31:09.306 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff6cc2700 1 -- start start 2020-07-16T20:31:09.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff6cc2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdff0135560 0x7fdff012bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff6cc2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff0148710 con 0x7fdff00a7470 2020-07-16T20:31:09.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff6cc2700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff01489b0 con 0x7fdff0133860 2020-07-16T20:31:09.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff6cc2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff0148c50 con 0x7fdff0135560 2020-07-16T20:31:09.315 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdfeffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdff0133860 0x7fdff012c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37144/0 (socket says 172.21.15.157:37144) 2020-07-16T20:31:09.315 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdfeffff700 1 -- 172.21.15.157:0/1576178089 learned_addr learned my addr 172.21.15.157:0/1576178089 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:09.315 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069820558 0 0) 0x7fdff01489b0 con 0x7fdff0133860 2020-07-16T20:31:09.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc8003240 con 0x7fdff0133860 2020-07-16T20:31:09.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.298+0000 7fdff525f700 1 --2- 172.21.15.157:0/1576178089 >> v2:172.21.15.41:3300/0 conn(0x7fdff0135560 0x7fdff012bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2467911280 0 0) 0x7fdfc8003240 con 0x7fdff0133860 2020-07-16T20:31:09.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdff01489b0 con 0x7fdff0133860 2020-07-16T20:31:09.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fdfe40012a0 con 0x7fdff0133860 2020-07-16T20:31:09.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 >> v2:172.21.15.41:3300/0 conn(0x7fdff0135560 msgr2=0x7fdff012bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> v2:172.21.15.41:3300/0 conn(0x7fdff0135560 0x7fdff012bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 >> v1:172.21.15.157:6789/0 conn(0x7fdff0133860 legacy=0x7fdff012c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 >> v1:172.21.15.41:6789/0 conn(0x7fdff00a7470 legacy=0x7fdff012b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdfc8003800 0x7fdfc8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 0x7fdfc8004960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8004e50 0x7fdfc800b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0148c50 con 0x7fdfc8004e50 2020-07-16T20:31:09.321 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc800bc20 con 0x7fdfc80044e0 2020-07-16T20:31:09.324 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc800bd60 con 0x7fdfc8003800 2020-07-16T20:31:09.324 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 0x7fdfc8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff4a5e700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdfc8003800 0x7fdfc8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff525f700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8004e50 0x7fdfc800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.325 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 -- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdfc8003800 msgr2=0x7fdfc8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.326 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fdfc8003800 0x7fdfc8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.326 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 -- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8004e50 msgr2=0x7fdfc800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.327 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8004e50 0x7fdfc800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.327 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0148400 con 0x7fdfc80044e0 2020-07-16T20:31:09.327 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff525f700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8004e50 0x7fdfc800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff0138fe0 con 0x7fdfc80044e0 2020-07-16T20:31:09.328 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff525f700 1 -- 172.21.15.157:0/1576178089 reap_dead start 2020-07-16T20:31:09.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01492b0 con 0x7fdfc80044e0 2020-07-16T20:31:09.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfeffff700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 0x7fdfc8004960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdfe4002f30 tx=0x7fdfe40017b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe400cc90 con 0x7fdfc80044e0 2020-07-16T20:31:09.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400cdf0 con 0x7fdfc80044e0 2020-07-16T20:31:09.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.299+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe4006210 con 0x7fdfc80044e0 2020-07-16T20:31:09.330 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.300+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdff0057490 con 0x7fdfc80044e0 2020-07-16T20:31:09.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.300+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fdfe4006370 con 0x7fdfc80044e0 2020-07-16T20:31:09.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 0x7fdfc8056480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdfe4068b60 con 0x7fdfc80044e0 2020-07-16T20:31:09.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdff4a5e700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 0x7fdfc8056480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdfecff9700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 0x7fdfc805dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfc805e3c0 con 0x7fdfc805b950 2020-07-16T20:31:09.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe4068f20 con 0x7fdfc80044e0 2020-07-16T20:31:09.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdff525f700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 0x7fdfc805dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdff4a5e700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 0x7fdfc8056480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fdfe000c000 tx=0x7fdfe0008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.301+0000 7fdff525f700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 0x7fdfc805dd70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.335 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.302+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== osd.1 v2:172.21.15.157:6818/23739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fdfc805e3c0 con 0x7fdfc805b950 2020-07-16T20:31:09.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 --> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdff005c6a0 con 0x7fdfc805b950 2020-07-16T20:31:09.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdfecff9700 1 -- 172.21.15.157:0/1576178089 <== osd.1 v2:172.21.15.157:6818/23739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdff005c6a0 con 0x7fdfc805b950 2020-07-16T20:31:09.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 msgr2=0x7fdfc805dd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 0x7fdfc805dd70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 msgr2=0x7fdfc8056480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 0x7fdfc8056480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fdfe000c000 tx=0x7fdfe0008040).stop 2020-07-16T20:31:09.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 msgr2=0x7fdfc8004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.318+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 0x7fdfc8004960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdfe4002f30 tx=0x7fdfe40017b0).stop 2020-07-16T20:31:09.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 shutdown_connections 2020-07-16T20:31:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6818/23739,v1:172.21.15.157:6819/23739] conn(0x7fdfc805b950 0x7fdfc805dd70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fdfc8053fc0 0x7fdfc8056480 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 --2- 172.21.15.157:0/1576178089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc80044e0 0x7fdfc8004960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 >> 172.21.15.157:0/1576178089 conn(0x7fdff009e7e0 msgr2=0x7fdff00a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 shutdown_connections 2020-07-16T20:31:09.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.319+0000 7fdff6cc2700 1 -- 172.21.15.157:0/1576178089 wait complete. 2020-07-16T20:31:09.342 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:09.342 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:09.343 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:09.343 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2020-07-16T20:31:09.450 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.450+0000 7f6f7137d700 1 Processor -- start 2020-07-16T20:31:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.450+0000 7f6f7137d700 1 -- start start 2020-07-16T20:31:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f6c0a48e0 0x7f6f6c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6f6c0a8420 0x7f6f6c0abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0a5450 con 0x7f6f6c0a7fb0 2020-07-16T20:31:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0a7880 con 0x7f6f6c0a8420 2020-07-16T20:31:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0a56b0 con 0x7f6f6c0a48e0 2020-07-16T20:31:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f6c0a48e0 0x7f6f6c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6a7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6f6c0a7fb0 0x7f6f6c0ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37160/0 (socket says 172.21.15.157:37160) 2020-07-16T20:31:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6a7fc700 1 -- 172.21.15.157:0/849819278 learned_addr learned my addr 172.21.15.157:0/849819278 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 -- 172.21.15.157:0/849819278 >> v2:172.21.15.41:3300/0 conn(0x7f6f6c0a8420 msgr2=0x7f6f6c0abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6b7fe700 1 --2- 172.21.15.157:0/849819278 >> v2:172.21.15.41:3300/0 conn(0x7f6f6c0a8420 0x7f6f6c0abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f69ffb700 1 -- 172.21.15.157:0/849819278 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961298192 0 0) 0x7f6f6c0a5450 con 0x7f6f6c0a7fb0 2020-07-16T20:31:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 --2- 172.21.15.157:0/849819278 >> v2:172.21.15.41:3300/0 conn(0x7f6f6c0a8420 0x7f6f6c0abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 -- 172.21.15.157:0/849819278 >> v1:172.21.15.157:6789/0 conn(0x7f6f6c0a7fb0 legacy=0x7f6f6c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 -- 172.21.15.157:0/849819278 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0a5950 con 0x7f6f6c0a48e0 2020-07-16T20:31:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f6affd700 1 --2- 172.21.15.157:0/849819278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0a48e0 0x7f6f6c0a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6f60002f30 tx=0x7f6f60006dd0).ready entity=mon.1 client_cookie=1e75807eeeb8829b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f69ffb700 1 -- 172.21.15.157:0/849819278 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f600097f0 con 0x7f6f6c0a48e0 2020-07-16T20:31:09.457 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f69ffb700 1 -- 172.21.15.157:0/849819278 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60009950 con 0x7f6f6c0a48e0 2020-07-16T20:31:09.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f69ffb700 1 -- 172.21.15.157:0/849819278 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f60009cb0 con 0x7f6f6c0a48e0 2020-07-16T20:31:09.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- 172.21.15.157:0/849819278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0a48e0 msgr2=0x7f6f6c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.459 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 --2- 172.21.15.157:0/849819278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0a48e0 0x7f6f6c0a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6f60002f30 tx=0x7f6f60006dd0).stop 2020-07-16T20:31:09.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- 172.21.15.157:0/849819278 shutdown_connections 2020-07-16T20:31:09.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 --2- 172.21.15.157:0/849819278 >> v2:172.21.15.41:3300/0 conn(0x7f6f6c0a8420 0x7f6f6c0abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 --2- 172.21.15.157:0/849819278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0a48e0 0x7f6f6c0a4cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- 172.21.15.157:0/849819278 >> 172.21.15.157:0/849819278 conn(0x7f6f6c061820 msgr2=0x7f6f6c09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.460 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- 172.21.15.157:0/849819278 shutdown_connections 2020-07-16T20:31:09.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.451+0000 7f6f7137d700 1 -- 172.21.15.157:0/849819278 wait complete. 2020-07-16T20:31:09.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 Processor -- start 2020-07-16T20:31:09.461 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 -- start start 2020-07-16T20:31:09.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 0x7f6f6c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f6c0abd40 0x7f6f6c147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c13a120 con 0x7f6f6c0a7fb0 2020-07-16T20:31:09.464 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c136e90 con 0x7f6f6c0abd40 2020-07-16T20:31:09.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.453+0000 7f6f7137d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c134fe0 con 0x7f6f6c0a8420 2020-07-16T20:31:09.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f6c0abd40 0x7f6f6c147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f6c0abd40 0x7f6f6c147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34480/0 (socket says 172.21.15.157:34480) 2020-07-16T20:31:09.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 -- 172.21.15.157:0/3827387097 learned_addr learned my addr 172.21.15.157:0/3827387097 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6a7fc700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 0x7f6f6c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 -- 172.21.15.157:0/3827387097 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 msgr2=0x7f6f6c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 0x7f6f6c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 -- 172.21.15.157:0/3827387097 >> v1:172.21.15.41:6789/0 conn(0x7f6f6c0a7fb0 legacy=0x7f6f6c139a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 -- 172.21.15.157:0/3827387097 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c135280 con 0x7f6f6c0abd40 2020-07-16T20:31:09.467 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6a7fc700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 0x7f6f6c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:09.467 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f6b7fe700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0abd40 0x7f6f6c147000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6f6c0a9970 tx=0x7f6f64008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.468 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f640077e0 con 0x7f6f6c0abd40 2020-07-16T20:31:09.468 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64007940 con 0x7f6f6c0abd40 2020-07-16T20:31:09.469 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c135720 con 0x7f6f6c0abd40 2020-07-16T20:31:09.469 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f64007ca0 con 0x7f6f6c0abd40 2020-07-16T20:31:09.469 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.454+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c0a9c00 con 0x7f6f6c0abd40 2020-07-16T20:31:09.469 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.455+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c135410 con 0x7f6f6c0abd40 2020-07-16T20:31:09.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.455+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6f6401b460 con 0x7f6f6c0abd40 2020-07-16T20:31:09.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.455+0000 7f6f52ffd700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 0x7f6f48052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.456+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6f64067f80 con 0x7f6f6c0abd40 2020-07-16T20:31:09.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.456+0000 7f6f6affd700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 0x7f6f48052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.470 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.456+0000 7f6f6affd700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 0x7f6f48052490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6f60002f30 tx=0x7f6f60015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.478 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.459+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6f640406b0 con 0x7f6f6c0abd40 2020-07-16T20:31:09.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.606+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f6c13a120 con 0x7f6f4804ffd0 2020-07-16T20:31:09.607 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.606+0000 7f6f52ffd700 1 -- 172.21.15.157:0/3827387097 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f6c13a120 con 0x7f6f4804ffd0 2020-07-16T20:31:09.608 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 msgr2=0x7f6f48052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 0x7f6f48052490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6f60002f30 tx=0x7f6f60015000).stop 2020-07-16T20:31:09.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0abd40 msgr2=0x7f6f6c147000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0abd40 0x7f6f6c147000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6f6c0a9970 tx=0x7f6f64008040).stop 2020-07-16T20:31:09.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 shutdown_connections 2020-07-16T20:31:09.609 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6f4804ffd0 0x7f6f48052490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.610 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c0abd40 0x7f6f6c147000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.610 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 --2- 172.21.15.157:0/3827387097 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6f6c0a8420 0x7f6f6c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.610 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 >> 172.21.15.157:0/3827387097 conn(0x7f6f6c061820 msgr2=0x7f6f6c130ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.610 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 shutdown_connections 2020-07-16T20:31:09.611 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.608+0000 7f6f7137d700 1 -- 172.21.15.157:0/3827387097 wait complete. 2020-07-16T20:31:09.611 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 1 to deep-scrub 2020-07-16T20:31:09.618 INFO:tasks.ceph:Scrubbing osd.2 2020-07-16T20:31:09.619 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:09.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.729+0000 7fd18d294700 1 Processor -- start 2020-07-16T20:31:09.730 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.729+0000 7fd18d294700 1 -- start start 2020-07-16T20:31:09.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd18d294700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1881373b0 0x7fd188137840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd18d294700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd188137d30 0x7fd188141f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.732 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd18d294700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880a5430 con 0x7fd18813acc0 2020-07-16T20:31:09.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd18d294700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880a65e0 con 0x7fd188137d30 2020-07-16T20:31:09.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd18d294700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880a6880 con 0x7fd1881373b0 2020-07-16T20:31:09.733 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1881373b0 0x7fd188137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1881373b0 0x7fd188137840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34486/0 (socket says 172.21.15.157:34486) 2020-07-16T20:31:09.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 -- 172.21.15.157:0/3686036912 learned_addr learned my addr 172.21.15.157:0/3686036912 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.734 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1877fe700 1 --2- 172.21.15.157:0/3686036912 >> v2:172.21.15.41:3300/0 conn(0x7fd188137d30 0x7fd188141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 -- 172.21.15.157:0/3686036912 >> v2:172.21.15.41:3300/0 conn(0x7fd188137d30 msgr2=0x7fd188141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 --2- 172.21.15.157:0/3686036912 >> v2:172.21.15.41:3300/0 conn(0x7fd188137d30 0x7fd188141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 -- 172.21.15.157:0/3686036912 >> v1:172.21.15.41:6789/0 conn(0x7fd18813acc0 legacy=0x7fd18813b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 -- 172.21.15.157:0/3686036912 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880a6b20 con 0x7fd1881373b0 2020-07-16T20:31:09.735 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd1867fc700 1 --2- 172.21.15.157:0/3686036912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1881373b0 0x7fd188137840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fd178002f30 tx=0x7fd178006e90).ready entity=mon.1 client_cookie=2b88c88d142acfb6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.730+0000 7fd185ffb700 1 -- 172.21.15.157:0/3686036912 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd178009850 con 0x7fd1881373b0 2020-07-16T20:31:09.736 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd185ffb700 1 -- 172.21.15.157:0/3686036912 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1780099b0 con 0x7fd1881373b0 2020-07-16T20:31:09.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd185ffb700 1 -- 172.21.15.157:0/3686036912 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd178009d10 con 0x7fd1881373b0 2020-07-16T20:31:09.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 -- 172.21.15.157:0/3686036912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1881373b0 msgr2=0x7fd188137840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 --2- 172.21.15.157:0/3686036912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1881373b0 0x7fd188137840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fd178002f30 tx=0x7fd178006e90).stop 2020-07-16T20:31:09.737 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 -- 172.21.15.157:0/3686036912 shutdown_connections 2020-07-16T20:31:09.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 --2- 172.21.15.157:0/3686036912 >> v2:172.21.15.41:3300/0 conn(0x7fd188137d30 0x7fd188141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 --2- 172.21.15.157:0/3686036912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1881373b0 0x7fd188137840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 -- 172.21.15.157:0/3686036912 >> 172.21.15.157:0/3686036912 conn(0x7fd18809e7e0 msgr2=0x7fd18809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.738 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 -- 172.21.15.157:0/3686036912 shutdown_connections 2020-07-16T20:31:09.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.731+0000 7fd18d294700 1 -- 172.21.15.157:0/3686036912 wait complete. 2020-07-16T20:31:09.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.732+0000 7fd18d294700 1 Processor -- start 2020-07-16T20:31:09.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.732+0000 7fd18d294700 1 -- start start 2020-07-16T20:31:09.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd18d294700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd188147540 0x7fd188139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.744 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd18d294700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880a21c0 con 0x7fd188137d30 2020-07-16T20:31:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd18d294700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd188130580 con 0x7fd18813acc0 2020-07-16T20:31:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd18d294700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd188130820 con 0x7fd188147540 2020-07-16T20:31:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd1867fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd18813acc0 0x7fd188146e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37180/0 (socket says 172.21.15.157:37180) 2020-07-16T20:31:09.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd1867fc700 1 -- 172.21.15.157:0/2617449584 learned_addr learned my addr 172.21.15.157:0/2617449584 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944579016 0 0) 0x7fd188130580 con 0x7fd18813acc0 2020-07-16T20:31:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd164003240 con 0x7fd18813acc0 2020-07-16T20:31:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd1877fe700 1 --2- 172.21.15.157:0/2617449584 >> v2:172.21.15.41:3300/0 conn(0x7fd188147540 0x7fd188139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2062166166 0 0) 0x7fd164003240 con 0x7fd18813acc0 2020-07-16T20:31:09.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd188130580 con 0x7fd18813acc0 2020-07-16T20:31:09.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7fd178009850 con 0x7fd18813acc0 2020-07-16T20:31:09.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 >> v2:172.21.15.41:3300/0 conn(0x7fd188147540 msgr2=0x7fd188139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> v2:172.21.15.41:3300/0 conn(0x7fd188147540 0x7fd188139900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 >> v1:172.21.15.157:6789/0 conn(0x7fd18813acc0 legacy=0x7fd188146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 >> v1:172.21.15.41:6789/0 conn(0x7fd188137d30 legacy=0x7fd1880a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 0x7fd164003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd1640044e0 0x7fd164004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd164004e10 0x7fd16400b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188130820 con 0x7fd164004e10 2020-07-16T20:31:09.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640052c0 con 0x7fd164003800 2020-07-16T20:31:09.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16400bc20 con 0x7fd1640044e0 2020-07-16T20:31:09.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.733+0000 7fd186ffd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 0x7fd164003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd1867fc700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd1640044e0 0x7fd164004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd1877fe700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd164004e10 0x7fd16400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 -- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd1640044e0 msgr2=0x7fd164004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd1640044e0 0x7fd164004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 -- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd164004e10 msgr2=0x7fd16400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd164004e10 0x7fd16400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188130270 con 0x7fd164003800 2020-07-16T20:31:09.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd1877fe700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd164004e10 0x7fd16400b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd1877fe700 1 -- 172.21.15.157:0/2617449584 reap_dead start 2020-07-16T20:31:09.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1880a1910 con 0x7fd164003800 2020-07-16T20:31:09.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd1867fc700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7fd1640044e0 0x7fd164004920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd188139900 con 0x7fd164003800 2020-07-16T20:31:09.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd186ffd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 0x7fd164003c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd1881370b0 tx=0x7fd17c007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17c007020 con 0x7fd164003800 2020-07-16T20:31:09.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c007180 con 0x7fd164003800 2020-07-16T20:31:09.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.734+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17c0064f0 con 0x7fd164003800 2020-07-16T20:31:09.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.735+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd188057490 con 0x7fd164003800 2020-07-16T20:31:09.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.735+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd17c010070 con 0x7fd164003800 2020-07-16T20:31:09.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.735+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 0x7fd164056220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.735+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd17c066ba0 con 0x7fd164003800 2020-07-16T20:31:09.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd1867fc700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 0x7fd164056220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd16effd700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 0x7fd16405db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd16405e170 con 0x7fd16405b700 2020-07-16T20:31:09.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd17c069210 con 0x7fd164003800 2020-07-16T20:31:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd1877fe700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 0x7fd16405db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd1867fc700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 0x7fd164056220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd17801a000 tx=0x7fd178015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.736+0000 7fd1877fe700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 0x7fd16405db20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.737+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== osd.2 v2:172.21.15.157:6810/23738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fd16405e170 con 0x7fd16405b700 2020-07-16T20:31:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.753+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 --> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd188043fd0 con 0x7fd16405b700 2020-07-16T20:31:09.759 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.753+0000 7fd16effd700 1 -- 172.21.15.157:0/2617449584 <== osd.2 v2:172.21.15.157:6810/23738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd188043fd0 con 0x7fd16405b700 2020-07-16T20:31:09.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 msgr2=0x7fd16405db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 0x7fd16405db20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 msgr2=0x7fd164056220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.760 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 0x7fd164056220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd17801a000 tx=0x7fd178015000).stop 2020-07-16T20:31:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 msgr2=0x7fd164003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 0x7fd164003c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd1881370b0 tx=0x7fd17c007b70).stop 2020-07-16T20:31:09.762 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 shutdown_connections 2020-07-16T20:31:09.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6810/23738,v1:172.21.15.157:6811/23738] conn(0x7fd16405b700 0x7fd16405db20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7fd164053d60 0x7fd164056220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 --2- 172.21.15.157:0/2617449584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164003800 0x7fd164003c20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.763 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 >> 172.21.15.157:0/2617449584 conn(0x7fd18809e7e0 msgr2=0x7fd18813b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 shutdown_connections 2020-07-16T20:31:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.754+0000 7fd18d294700 1 -- 172.21.15.157:0/2617449584 wait complete. 2020-07-16T20:31:09.764 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:09.764 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:09.765 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:09.766 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2020-07-16T20:31:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.872+0000 7ffa03f43700 1 Processor -- start 2020-07-16T20:31:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.872+0000 7ffa03f43700 1 -- start start 2020-07-16T20:31:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc066d40 0x7ff9fc13d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 0x7ff9fc13d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc137000 con 0x7ff9fc13cb00 2020-07-16T20:31:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc05cd90 con 0x7ff9fc066d40 2020-07-16T20:31:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa03f43700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc05d030 con 0x7ff9fc0671d0 2020-07-16T20:31:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc066d40 0x7ff9fc13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc066d40 0x7ff9fc13d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34508/0 (socket says 172.21.15.157:34508) 2020-07-16T20:31:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 -- 172.21.15.157:0/74064686 learned_addr learned my addr 172.21.15.157:0/74064686 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa01cdf700 1 --2- 172.21.15.157:0/74064686 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa024e0700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 0x7ff9fc13d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 -- 172.21.15.157:0/74064686 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 msgr2=0x7ff9fc13d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 0x7ff9fc13d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 -- 172.21.15.157:0/74064686 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 msgr2=0x7ff9fc0a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.873+0000 7ffa014de700 1 --2- 172.21.15.157:0/74064686 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc0a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa014de700 1 -- 172.21.15.157:0/74064686 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc05d2d0 con 0x7ff9fc066d40 2020-07-16T20:31:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa01cdf700 1 --2- 172.21.15.157:0/74064686 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa024e0700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 0x7ff9fc13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa014de700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc066d40 0x7ff9fc13d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff9f8002f30 tx=0x7ff9f8006e90).ready entity=mon.1 client_cookie=5b0c8036b73a98e4 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa00cdd700 1 -- 172.21.15.157:0/74064686 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f8009850 con 0x7ff9fc066d40 2020-07-16T20:31:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa00cdd700 1 -- 172.21.15.157:0/74064686 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80099b0 con 0x7ff9fc066d40 2020-07-16T20:31:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa00cdd700 1 -- 172.21.15.157:0/74064686 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f8009d10 con 0x7ff9fc066d40 2020-07-16T20:31:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 -- 172.21.15.157:0/74064686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc066d40 msgr2=0x7ff9fc13d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc066d40 0x7ff9fc13d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff9f8002f30 tx=0x7ff9f8006e90).stop 2020-07-16T20:31:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 -- 172.21.15.157:0/74064686 shutdown_connections 2020-07-16T20:31:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff9fc0671d0 0x7ff9fc13d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 --2- 172.21.15.157:0/74064686 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc0a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 --2- 172.21.15.157:0/74064686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc066d40 0x7ff9fc13d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 -- 172.21.15.157:0/74064686 >> 172.21.15.157:0/74064686 conn(0x7ff9fc0600e0 msgr2=0x7ff9fc066630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 -- 172.21.15.157:0/74064686 shutdown_connections 2020-07-16T20:31:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.874+0000 7ffa03f43700 1 -- 172.21.15.157:0/74064686 wait complete. 2020-07-16T20:31:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.875+0000 7ffa03f43700 1 Processor -- start 2020-07-16T20:31:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.875+0000 7ffa03f43700 1 -- start start 2020-07-16T20:31:09.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa03f43700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.886 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa03f43700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa03f43700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc148f80 con 0x7ff9fc0671d0 2020-07-16T20:31:09.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa03f43700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc149220 con 0x7ff9fc13cb00 2020-07-16T20:31:09.887 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa03f43700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc1494c0 con 0x7ff9fc148ae0 2020-07-16T20:31:09.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34516/0 (socket says 172.21.15.157:34516) 2020-07-16T20:31:09.888 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 -- 172.21.15.157:0/274568818 learned_addr learned my addr 172.21.15.157:0/274568818 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:09.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa014de700 1 --2- 172.21.15.157:0/274568818 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.889 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 -- 172.21.15.157:0/274568818 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 msgr2=0x7ff9fc139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 --2- 172.21.15.157:0/274568818 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:09.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 -- 172.21.15.157:0/274568818 >> v1:172.21.15.41:6789/0 conn(0x7ff9fc0671d0 legacy=0x7ff9fc14c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:09.891 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 -- 172.21.15.157:0/274568818 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc149960 con 0x7ff9fc148ae0 2020-07-16T20:31:09.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa014de700 1 --2- 172.21.15.157:0/274568818 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:09.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ffa024e0700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff9f4007000 tx=0x7ff9f4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4015070 con 0x7ff9fc148ae0 2020-07-16T20:31:09.892 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.876+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f40078d0 con 0x7ff9fc148ae0 2020-07-16T20:31:09.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.877+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc13efb0 con 0x7ff9fc148ae0 2020-07-16T20:31:09.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.877+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4007c30 con 0x7ff9fc148ae0 2020-07-16T20:31:09.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.877+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc14ce70 con 0x7ff9fc148ae0 2020-07-16T20:31:09.893 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.878+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc057490 con 0x7ff9fc148ae0 2020-07-16T20:31:09.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.878+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff9f401a410 con 0x7ff9fc148ae0 2020-07-16T20:31:09.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.878+0000 7ff9e9ffb700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 0x7ff9d40524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:09.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.878+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff9f4067fc0 con 0x7ff9fc148ae0 2020-07-16T20:31:09.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.878+0000 7ffa01cdf700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 0x7ff9d40524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:09.894 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.879+0000 7ffa01cdf700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 0x7ff9d40524d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ff9fc139c50 tx=0x7ff9ec008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:09.895 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:09.881+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff9f40406f0 con 0x7ff9fc148ae0 2020-07-16T20:31:10.033 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.033+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9fc043fd0 con 0x7ff9d4050010 2020-07-16T20:31:10.034 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.033+0000 7ff9e9ffb700 1 -- 172.21.15.157:0/274568818 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff9fc043fd0 con 0x7ff9d4050010 2020-07-16T20:31:10.035 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 msgr2=0x7ff9d40524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 0x7ff9d40524d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ff9fc139c50 tx=0x7ff9ec008040).stop 2020-07-16T20:31:10.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc148ae0 msgr2=0x7ff9fc14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff9f4007000 tx=0x7ff9f4008040).stop 2020-07-16T20:31:10.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 shutdown_connections 2020-07-16T20:31:10.036 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff9d4050010 0x7ff9d40524d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.037 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 --2- 172.21.15.157:0/274568818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9fc148ae0 0x7ff9fc14c7c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 --2- 172.21.15.157:0/274568818 >> v2:172.21.15.41:3300/0 conn(0x7ff9fc13cb00 0x7ff9fc139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 >> 172.21.15.157:0/274568818 conn(0x7ff9fc0600e0 msgr2=0x7ff9fc13a930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.038 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 shutdown_connections 2020-07-16T20:31:10.039 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.035+0000 7ffa03f43700 1 -- 172.21.15.157:0/274568818 wait complete. 2020-07-16T20:31:10.040 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 2 to deep-scrub 2020-07-16T20:31:10.045 INFO:tasks.ceph:Scrubbing osd.3 2020-07-16T20:31:10.046 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:10.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.157+0000 7efedfd1d700 1 Processor -- start 2020-07-16T20:31:10.158 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.157+0000 7efedfd1d700 1 -- start start 2020-07-16T20:31:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efedfd1d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed813acc0 0x7efed813b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efedfd1d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80a5430 con 0x7efed8134010 2020-07-16T20:31:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efedfd1d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80a65e0 con 0x7efed8134b80 2020-07-16T20:31:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efedfd1d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a6880 con 0x7efed813acc0 2020-07-16T20:31:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efede2ba700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7efed8134b80 0x7efed8141f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37212/0 (socket says 172.21.15.157:37212) 2020-07-16T20:31:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efede2ba700 1 -- 172.21.15.157:0/2660341867 learned_addr learned my addr 172.21.15.157:0/2660341867 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.158+0000 7efeddab9700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed813acc0 0x7efed813b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235681618 0 0) 0x7efed80a65e0 con 0x7efed8134b80 2020-07-16T20:31:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec0003240 con 0x7efed8134b80 2020-07-16T20:31:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374302824 0 0) 0x7efed80a5430 con 0x7efed8134010 2020-07-16T20:31:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed80a65e0 con 0x7efed8134010 2020-07-16T20:31:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2726377304 0 0) 0x7efec0003240 con 0x7efed8134b80 2020-07-16T20:31:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed813acc0 msgr2=0x7efed813b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed813acc0 0x7efed813b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 >> v1:172.21.15.41:6789/0 conn(0x7efed8134010 legacy=0x7efed8134470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80a6b20 con 0x7efed8134b80 2020-07-16T20:31:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7efed0001a90 con 0x7efed8134b80 2020-07-16T20:31:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 >> v1:172.21.15.157:6789/0 conn(0x7efed8134b80 legacy=0x7efed8141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efec00038c0 0x7efec0003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efec00044e0 0x7efec0004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efec0004e50 0x7efec000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.173 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a6880 con 0x7efec00044e0 2020-07-16T20:31:10.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec000bc20 con 0x7efec0004e50 2020-07-16T20:31:10.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec000bd60 con 0x7efec00038c0 2020-07-16T20:31:10.174 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efeddab9700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed813acc0 0x7efed813b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efec0004e50 0x7efec000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedd2b8700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efec00044e0 0x7efec0004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efeddab9700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efec00038c0 0x7efec0003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 -- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efec00038c0 msgr2=0x7efec0003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efec00038c0 0x7efec0003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 -- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efec00044e0 msgr2=0x7efec0004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efec00044e0 0x7efec0004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 -- 172.21.15.157:0/2660341867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0003240 con 0x7efec0004e50 2020-07-16T20:31:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efede2ba700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efec0004e50 0x7efec000b730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efec00054b0 tx=0x7efed80a7310).ready entity=mon.1 client_cookie=b3cdc3bfc4a89b20 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.159+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed0005c50 con 0x7efec0004e50 2020-07-16T20:31:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0005db0 con 0x7efec0004e50 2020-07-16T20:31:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedcab7700 1 -- 172.21.15.157:0/2660341867 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed00072c0 con 0x7efec0004e50 2020-07-16T20:31:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 -- 172.21.15.157:0/2660341867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efec0004e50 msgr2=0x7efec000b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 --2- 172.21.15.157:0/2660341867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efec0004e50 0x7efec000b730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efec00054b0 tx=0x7efed80a7310).stop 2020-07-16T20:31:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efede2ba700 1 -- 172.21.15.157:0/2660341867 reap_dead start 2020-07-16T20:31:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 -- 172.21.15.157:0/2660341867 shutdown_connections 2020-07-16T20:31:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 -- 172.21.15.157:0/2660341867 >> 172.21.15.157:0/2660341867 conn(0x7efed809e7e0 msgr2=0x7efed809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 -- 172.21.15.157:0/2660341867 shutdown_connections 2020-07-16T20:31:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.160+0000 7efedfd1d700 1 -- 172.21.15.157:0/2660341867 wait complete. 2020-07-16T20:31:10.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.161+0000 7efedfd1d700 1 Processor -- start 2020-07-16T20:31:10.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.161+0000 7efedfd1d700 1 -- start start 2020-07-16T20:31:10.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed80a9fc0 0x7efed812c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.181 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efed80ac0e0 0x7efed812ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed8138540 con 0x7efed80ab8d0 2020-07-16T20:31:10.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed813a630 con 0x7efed80ac0e0 2020-07-16T20:31:10.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed8137b60 con 0x7efed80a9fc0 2020-07-16T20:31:10.182 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efeddab9700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7efed80ab8d0 0x7efed80a98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37220/0 (socket says 172.21.15.157:37220) 2020-07-16T20:31:10.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efed80ac0e0 0x7efed812ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efeddab9700 1 -- 172.21.15.157:0/2640097936 learned_addr learned my addr 172.21.15.157:0/2640097936 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:10.183 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedd2b8700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed80a9fc0 0x7efed812c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 -- 172.21.15.157:0/2640097936 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed80a9fc0 msgr2=0x7efed812c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7efed80a9fc0 0x7efed812c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.184 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 -- 172.21.15.157:0/2640097936 >> v1:172.21.15.157:6789/0 conn(0x7efed80ab8d0 legacy=0x7efed80a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 -- 172.21.15.157:0/2640097936 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8137e00 con 0x7efed80ac0e0 2020-07-16T20:31:10.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876158374 0 0) 0x7efed8138540 con 0x7efed80ab8d0 2020-07-16T20:31:10.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efede2ba700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efed80ac0e0 0x7efed812ce70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7efed813aba0 tx=0x7efed0013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.185 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed0005c50 con 0x7efed80ac0e0 2020-07-16T20:31:10.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000b070 con 0x7efed80ac0e0 2020-07-16T20:31:10.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed81380a0 con 0x7efed80ac0e0 2020-07-16T20:31:10.186 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed0013850 con 0x7efed80ac0e0 2020-07-16T20:31:10.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.162+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80abe70 con 0x7efed80ac0e0 2020-07-16T20:31:10.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.163+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efed8057490 con 0x7efed80ac0e0 2020-07-16T20:31:10.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.163+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7efed001c030 con 0x7efed80ac0e0 2020-07-16T20:31:10.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efec5ffb700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7efeb004fec0 0x7efeb0052380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.187 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efed0068110 con 0x7efed80ac0e0 2020-07-16T20:31:10.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efeddab9700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7efeb004fec0 0x7efeb0052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efec5ffb700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7efeb0057a30 0x7efeb0059e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.188 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 --> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efeb005a4a0 con 0x7efeb0057a30 2020-07-16T20:31:10.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efed006a780 con 0x7efed80ac0e0 2020-07-16T20:31:10.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efedd2b8700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7efeb0057a30 0x7efeb0059e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efeddab9700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7efeb004fec0 0x7efeb0052380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efec8007000 tx=0x7efec8008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.189 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.164+0000 7efedd2b8700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7efeb0057a30 0x7efeb0059e50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.190 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.165+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== osd.3 v2:172.21.15.157:6826/23750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7efeb005a4a0 con 0x7efeb0057a30 2020-07-16T20:31:10.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.181+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 --> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efed8043fd0 con 0x7efeb0057a30 2020-07-16T20:31:10.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.181+0000 7efec5ffb700 1 -- 172.21.15.157:0/2640097936 <== osd.3 v2:172.21.15.157:6826/23750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efed8043fd0 con 0x7efeb0057a30 2020-07-16T20:31:10.192 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7efeb0057a30 msgr2=0x7efeb0059e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6826/23750,v1:172.21.15.157:6827/23750] conn(0x7efeb0057a30 0x7efeb0059e50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7efeb004fec0 msgr2=0x7efeb0052380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.193 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7efeb004fec0 0x7efeb0052380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efec8007000 tx=0x7efec8008040).stop 2020-07-16T20:31:10.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efed80ac0e0 msgr2=0x7efed812ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efed80ac0e0 0x7efed812ce70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7efed813aba0 tx=0x7efed0013000).stop 2020-07-16T20:31:10.194 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efede2ba700 1 -- 172.21.15.157:0/2640097936 reap_dead start 2020-07-16T20:31:10.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 shutdown_connections 2020-07-16T20:31:10.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 --2- 172.21.15.157:0/2640097936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efed80ac0e0 0x7efed812ce70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.195 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 >> 172.21.15.157:0/2640097936 conn(0x7efed809e7e0 msgr2=0x7efed813b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.196 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 shutdown_connections 2020-07-16T20:31:10.196 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.182+0000 7efedfd1d700 1 -- 172.21.15.157:0/2640097936 wait complete. 2020-07-16T20:31:10.197 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:10.197 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:10.197 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:10.198 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2020-07-16T20:31:10.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.304+0000 7f84904e4700 1 Processor -- start 2020-07-16T20:31:10.305 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.304+0000 7f84904e4700 1 -- start start 2020-07-16T20:31:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f84904e4700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8488132860 0x7f8488132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.312 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f84904e4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f848813e260 0x7f8488140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.312 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f84904e4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880a3d00 con 0x7f84880ac240 2020-07-16T20:31:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f84904e4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880a4130 con 0x7f848813e260 2020-07-16T20:31:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f84904e4700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84880a6ce0 con 0x7f8488132860 2020-07-16T20:31:10.313 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f848ea81700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f848813e260 0x7f8488140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f848ea81700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f848813e260 0x7f8488140650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34546/0 (socket says 172.21.15.157:34546) 2020-07-16T20:31:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f848ea81700 1 -- 172.21.15.157:0/2601663880 learned_addr learned my addr 172.21.15.157:0/2601663880 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:10.314 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.305+0000 7f848da7f700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8488132860 0x7f8488132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.315 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848ea81700 1 -- 172.21.15.157:0/2601663880 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8488132860 msgr2=0x7f8488132cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.315 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848ea81700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8488132860 0x7f8488132cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848ea81700 1 -- 172.21.15.157:0/2601663880 >> v1:172.21.15.41:6789/0 conn(0x7f84880ac240 legacy=0x7f8488135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848ea81700 1 -- 172.21.15.157:0/2601663880 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84880a4320 con 0x7f848813e260 2020-07-16T20:31:10.316 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848ea81700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848813e260 0x7f8488140650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480009270).ready entity=mon.1 client_cookie=412393f58900aee1 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848d27e700 1 -- 172.21.15.157:0/2601663880 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848000bc00 con 0x7f848813e260 2020-07-16T20:31:10.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848d27e700 1 -- 172.21.15.157:0/2601663880 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000bd60 con 0x7f848813e260 2020-07-16T20:31:10.317 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f848d27e700 1 -- 172.21.15.157:0/2601663880 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8480011400 con 0x7f848813e260 2020-07-16T20:31:10.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 -- 172.21.15.157:0/2601663880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848813e260 msgr2=0x7f8488140650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848813e260 0x7f8488140650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480009270).stop 2020-07-16T20:31:10.318 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 -- 172.21.15.157:0/2601663880 shutdown_connections 2020-07-16T20:31:10.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f848813e260 0x7f8488140650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.319 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 --2- 172.21.15.157:0/2601663880 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f8488132860 0x7f8488132cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.320 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 -- 172.21.15.157:0/2601663880 >> 172.21.15.157:0/2601663880 conn(0x7f8488061820 msgr2=0x7f848809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 -- 172.21.15.157:0/2601663880 shutdown_connections 2020-07-16T20:31:10.329 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.306+0000 7f84904e4700 1 -- 172.21.15.157:0/2601663880 wait complete. 2020-07-16T20:31:10.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.307+0000 7f84904e4700 1 Processor -- start 2020-07-16T20:31:10.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.307+0000 7f84904e4700 1 -- start start 2020-07-16T20:31:10.331 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84904e4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f84880ac240 0x7f8488131770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84904e4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8488145330 con 0x7f8488135690 2020-07-16T20:31:10.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84904e4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8488135e10 con 0x7f8488132860 2020-07-16T20:31:10.332 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84904e4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8488133a80 con 0x7f84880ac240 2020-07-16T20:31:10.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848da7f700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8488132860 0x7f8488144c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37238/0 (socket says 172.21.15.157:37238) 2020-07-16T20:31:10.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848da7f700 1 -- 172.21.15.157:0/3773017812 learned_addr learned my addr 172.21.15.157:0/3773017812 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:10.333 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848e280700 1 --2- 172.21.15.157:0/3773017812 >> v2:172.21.15.41:3300/0 conn(0x7f84880ac240 0x7f8488131770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369188149 0 0) 0x7f8488135e10 con 0x7f8488132860 2020-07-16T20:31:10.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8460003240 con 0x7f8488132860 2020-07-16T20:31:10.334 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1574393570 0 0) 0x7f8460003240 con 0x7f8488132860 2020-07-16T20:31:10.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848e280700 1 -- 172.21.15.157:0/3773017812 >> v1:172.21.15.157:6789/0 conn(0x7f8488132860 legacy=0x7f8488144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848e280700 1 -- 172.21.15.157:0/3773017812 >> v1:172.21.15.41:6789/0 conn(0x7f8488135690 legacy=0x7f848812aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.336 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.308+0000 7f848e280700 1 -- 172.21.15.157:0/3773017812 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488133d20 con 0x7f84880ac240 2020-07-16T20:31:10.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f848e280700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84880ac240 0x7f8488131770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8480006e80 tx=0x7f8478007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484006ea0 con 0x7f84880ac240 2020-07-16T20:31:10.337 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478007240 con 0x7f84880ac240 2020-07-16T20:31:10.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488135b20 con 0x7f84880ac240 2020-07-16T20:31:10.338 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84780073b0 con 0x7f84880ac240 2020-07-16T20:31:10.339 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.309+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8488134380 con 0x7f84880ac240 2020-07-16T20:31:10.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.310+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488133eb0 con 0x7f84880ac240 2020-07-16T20:31:10.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.310+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8478010020 con 0x7f84880ac240 2020-07-16T20:31:10.340 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.310+0000 7f84767fc700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 0x7f8460052750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.310+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8478066ff0 con 0x7f84880ac240 2020-07-16T20:31:10.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.310+0000 7f848da7f700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 0x7f8460052750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.341 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.311+0000 7f848da7f700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 0x7f8460052750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8484006b00 tx=0x7f84840015e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.342 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.315+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f847803f6c0 con 0x7f84880ac240 2020-07-16T20:31:10.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.462+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8488057490 con 0x7f8460050290 2020-07-16T20:31:10.463 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.463+0000 7f84767fc700 1 -- 172.21.15.157:0/3773017812 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8488057490 con 0x7f8460050290 2020-07-16T20:31:10.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 msgr2=0x7f8460052750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 0x7f8460052750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8484006b00 tx=0x7f84840015e0).stop 2020-07-16T20:31:10.465 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84880ac240 msgr2=0x7f8488131770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84880ac240 0x7f8488131770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8480006e80 tx=0x7f8478007aa0).stop 2020-07-16T20:31:10.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 shutdown_connections 2020-07-16T20:31:10.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f8460050290 0x7f8460052750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.466 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 --2- 172.21.15.157:0/3773017812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84880ac240 0x7f8488131770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.467 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 >> 172.21.15.157:0/3773017812 conn(0x7f8488061820 msgr2=0x7f848809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.467 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 shutdown_connections 2020-07-16T20:31:10.467 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.464+0000 7f84904e4700 1 -- 172.21.15.157:0/3773017812 wait complete. 2020-07-16T20:31:10.468 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 3 to deep-scrub 2020-07-16T20:31:10.475 INFO:tasks.ceph:Scrubbing osd.4 2020-07-16T20:31:10.476 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:10.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.585+0000 7eff7a143700 1 Processor -- start 2020-07-16T20:31:10.586 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.585+0000 7eff7a143700 1 -- start start 2020-07-16T20:31:10.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff7a143700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff740a7290 0x7eff7409ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.588 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff7a143700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7eff74133650 0x7eff740a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff7a143700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff74068260 con 0x7eff740a2ed0 2020-07-16T20:31:10.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff7a143700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff74067b20 con 0x7eff74133650 2020-07-16T20:31:10.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff7a143700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff74067dc0 con 0x7eff740a7290 2020-07-16T20:31:10.589 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff740a7290 0x7eff7409ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff78940700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7eff740a2ed0 0x7eff74132f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37244/0 (socket says 172.21.15.157:37244) 2020-07-16T20:31:10.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff78940700 1 -- 172.21.15.157:0/2191064699 learned_addr learned my addr 172.21.15.157:0/2191064699 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:10.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79942700 1 --2- 172.21.15.157:0/2191064699 >> v2:172.21.15.41:3300/0 conn(0x7eff74133650 0x7eff740a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.590 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 -- 172.21.15.157:0/2191064699 >> v2:172.21.15.41:3300/0 conn(0x7eff74133650 msgr2=0x7eff740a3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 --2- 172.21.15.157:0/2191064699 >> v2:172.21.15.41:3300/0 conn(0x7eff74133650 0x7eff740a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 -- 172.21.15.157:0/2191064699 >> v1:172.21.15.157:6789/0 conn(0x7eff740a2ed0 legacy=0x7eff74132f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff63fff700 1 -- 172.21.15.157:0/2191064699 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875539401 0 0) 0x7eff74068260 con 0x7eff740a2ed0 2020-07-16T20:31:10.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 -- 172.21.15.157:0/2191064699 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740a7670 con 0x7eff740a7290 2020-07-16T20:31:10.591 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.586+0000 7eff79141700 1 --2- 172.21.15.157:0/2191064699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff740a7290 0x7eff7409ea10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7eff64002f30 tx=0x7eff64006dd0).ready entity=mon.1 client_cookie=de06ed5db97b2b68 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff63fff700 1 -- 172.21.15.157:0/2191064699 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff640097f0 con 0x7eff740a7290 2020-07-16T20:31:10.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff63fff700 1 -- 172.21.15.157:0/2191064699 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64009950 con 0x7eff740a7290 2020-07-16T20:31:10.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff63fff700 1 -- 172.21.15.157:0/2191064699 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff64009cb0 con 0x7eff740a7290 2020-07-16T20:31:10.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 -- 172.21.15.157:0/2191064699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff740a7290 msgr2=0x7eff7409ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.592 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 --2- 172.21.15.157:0/2191064699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff740a7290 0x7eff7409ea10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7eff64002f30 tx=0x7eff64006dd0).stop 2020-07-16T20:31:10.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 -- 172.21.15.157:0/2191064699 shutdown_connections 2020-07-16T20:31:10.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 --2- 172.21.15.157:0/2191064699 >> v2:172.21.15.41:3300/0 conn(0x7eff74133650 0x7eff740a3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 --2- 172.21.15.157:0/2191064699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff740a7290 0x7eff7409ea10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.593 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 -- 172.21.15.157:0/2191064699 >> 172.21.15.157:0/2191064699 conn(0x7eff7405b810 msgr2=0x7eff7405bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 -- 172.21.15.157:0/2191064699 shutdown_connections 2020-07-16T20:31:10.594 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.587+0000 7eff7a143700 1 -- 172.21.15.157:0/2191064699 wait complete. 2020-07-16T20:31:10.596 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.588+0000 7eff7a143700 1 Processor -- start 2020-07-16T20:31:10.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.588+0000 7eff7a143700 1 -- start start 2020-07-16T20:31:10.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff7a143700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7eff740a2ed0 0x7eff7413edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff7a143700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7eff74133650 0x7eff74139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.597 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff7a143700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7413f680 con 0x7eff74149b50 2020-07-16T20:31:10.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff7a143700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7413a010 con 0x7eff740a2ed0 2020-07-16T20:31:10.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff7a143700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74134ea0 con 0x7eff74133650 2020-07-16T20:31:10.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7eff740a2ed0 0x7eff7413edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7eff740a2ed0 0x7eff7413edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:59798/0 (socket says 172.21.15.157:59798) 2020-07-16T20:31:10.598 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff78940700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7eff74133650 0x7eff74139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79942700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7eff74149b50 0x7eff7412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50828/0 (socket says 172.21.15.157:50828) 2020-07-16T20:31:10.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 -- 172.21.15.157:0/3374217642 learned_addr learned my addr 172.21.15.157:0/3374217642 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:10.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 -- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7eff74133650 msgr2=0x7eff74139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.599 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7eff74133650 0x7eff74139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 -- 172.21.15.157:0/3374217642 >> v1:172.21.15.41:6789/0 conn(0x7eff74149b50 legacy=0x7eff7412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743764420 0 0) 0x7eff7413f680 con 0x7eff74149b50 2020-07-16T20:31:10.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 -- 172.21.15.157:0/3374217642 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7413a210 con 0x7eff740a2ed0 2020-07-16T20:31:10.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.589+0000 7eff79141700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7eff740a2ed0 0x7eff7413edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7eff64002f30 tx=0x7eff64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.600 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff64011e80 con 0x7eff740a2ed0 2020-07-16T20:31:10.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6401d5d0 con 0x7eff740a2ed0 2020-07-16T20:31:10.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff6401d930 con 0x7eff740a2ed0 2020-07-16T20:31:10.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff741496b0 con 0x7eff740a2ed0 2020-07-16T20:31:10.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff74136c90 con 0x7eff740a2ed0 2020-07-16T20:31:10.601 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.590+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff74057490 con 0x7eff740a2ed0 2020-07-16T20:31:10.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7eff64025030 con 0x7eff740a2ed0 2020-07-16T20:31:10.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7eff4c04fda0 0x7eff4c052260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7eff64069760 con 0x7eff740a2ed0 2020-07-16T20:31:10.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff78940700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7eff4c04fda0 0x7eff4c052260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.602 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7eff4c057890 0x7eff4c059cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 --> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff4c05a300 con 0x7eff4c057890 2020-07-16T20:31:10.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff64069ac0 con 0x7eff740a2ed0 2020-07-16T20:31:10.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.591+0000 7eff78940700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7eff4c04fda0 0x7eff4c052260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7eff7000d000 tx=0x7eff70007920).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.592+0000 7eff79942700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7eff4c057890 0x7eff4c059cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.603 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.592+0000 7eff79942700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7eff4c057890 0x7eff4c059cb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.604 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.593+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== osd.4 v2:172.21.15.41:6800/23935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7eff4c05a300 con 0x7eff4c057890 2020-07-16T20:31:10.623 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.609+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 --> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7eff740a24a0 con 0x7eff4c057890 2020-07-16T20:31:10.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff617fa700 1 -- 172.21.15.157:0/3374217642 <== osd.4 v2:172.21.15.41:6800/23935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7eff740a24a0 con 0x7eff4c057890 2020-07-16T20:31:10.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7eff4c057890 msgr2=0x7eff4c059cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:6800/23935,v1:172.21.15.41:6801/23935] conn(0x7eff4c057890 0x7eff4c059cb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7eff4c04fda0 msgr2=0x7eff4c052260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.624 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7eff4c04fda0 0x7eff4c052260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7eff7000d000 tx=0x7eff70007920).stop 2020-07-16T20:31:10.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7eff740a2ed0 msgr2=0x7eff7413edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7eff740a2ed0 0x7eff7413edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7eff64002f30 tx=0x7eff64015000).stop 2020-07-16T20:31:10.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff79942700 1 -- 172.21.15.157:0/3374217642 reap_dead start 2020-07-16T20:31:10.625 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 shutdown_connections 2020-07-16T20:31:10.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 --2- 172.21.15.157:0/3374217642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7eff740a2ed0 0x7eff7413edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 >> 172.21.15.157:0/3374217642 conn(0x7eff7405b810 msgr2=0x7eff740a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 shutdown_connections 2020-07-16T20:31:10.626 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.610+0000 7eff7a143700 1 -- 172.21.15.157:0/3374217642 wait complete. 2020-07-16T20:31:10.626 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:10.627 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:10.627 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:10.627 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2020-07-16T20:31:10.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.738+0000 7f11765c0700 1 Processor -- start 2020-07-16T20:31:10.739 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.738+0000 7f11765c0700 1 -- start start 2020-07-16T20:31:10.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f11765c0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11700a24b0 0x7f11700a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f11765c0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1170137a40 0x7f1170137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.745 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f11765c0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700a68a0 con 0x7f117013aee0 2020-07-16T20:31:10.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f11765c0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700a5c70 con 0x7f1170137a40 2020-07-16T20:31:10.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f11765c0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11701372f0 con 0x7f11700a24b0 2020-07-16T20:31:10.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11700a24b0 0x7f11700a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.746 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f1174b5d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f117013aee0 0x7f11700ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37262/0 (socket says 172.21.15.157:37262) 2020-07-16T20:31:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f1174b5d700 1 -- 172.21.15.157:0/3727623160 learned_addr learned my addr 172.21.15.157:0/3727623160 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 -- 172.21.15.157:0/3727623160 >> v2:172.21.15.41:3300/0 conn(0x7f1170137a40 msgr2=0x7f1170137eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116f7fe700 1 --2- 172.21.15.157:0/3727623160 >> v2:172.21.15.41:3300/0 conn(0x7f1170137a40 0x7f1170137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 --2- 172.21.15.157:0/3727623160 >> v2:172.21.15.41:3300/0 conn(0x7f1170137a40 0x7f1170137eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116effd700 1 -- 172.21.15.157:0/3727623160 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038401913 0 0) 0x7f11700a68a0 con 0x7f117013aee0 2020-07-16T20:31:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 -- 172.21.15.157:0/3727623160 >> v1:172.21.15.157:6789/0 conn(0x7f117013aee0 legacy=0x7f11700ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 -- 172.21.15.157:0/3727623160 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117013aa40 con 0x7f11700a24b0 2020-07-16T20:31:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.739+0000 7f116ffff700 1 --2- 172.21.15.157:0/3727623160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11700a24b0 0x7f11700a4e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1160002f30 tx=0x7f1160006dd0).ready entity=mon.1 client_cookie=86535c147c3970c1 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f116effd700 1 -- 172.21.15.157:0/3727623160 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11600097f0 con 0x7f11700a24b0 2020-07-16T20:31:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f116effd700 1 -- 172.21.15.157:0/3727623160 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160009950 con 0x7f11700a24b0 2020-07-16T20:31:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f116effd700 1 -- 172.21.15.157:0/3727623160 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1160009cb0 con 0x7f11700a24b0 2020-07-16T20:31:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 -- 172.21.15.157:0/3727623160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11700a24b0 msgr2=0x7f11700a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 --2- 172.21.15.157:0/3727623160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11700a24b0 0x7f11700a4e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1160002f30 tx=0x7f1160006dd0).stop 2020-07-16T20:31:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 -- 172.21.15.157:0/3727623160 shutdown_connections 2020-07-16T20:31:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 --2- 172.21.15.157:0/3727623160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11700a24b0 0x7f11700a4e40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 --2- 172.21.15.157:0/3727623160 >> v2:172.21.15.41:3300/0 conn(0x7f1170137a40 0x7f1170137eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 -- 172.21.15.157:0/3727623160 >> 172.21.15.157:0/3727623160 conn(0x7f1170061820 msgr2=0x7f117009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 -- 172.21.15.157:0/3727623160 shutdown_connections 2020-07-16T20:31:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.740+0000 7f11765c0700 1 -- 172.21.15.157:0/3727623160 wait complete. 2020-07-16T20:31:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.741+0000 7f11765c0700 1 Processor -- start 2020-07-16T20:31:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.741+0000 7f11765c0700 1 -- start start 2020-07-16T20:31:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1170137a40 0x7f1170062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 0x7f11701399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 0x7f1170130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1170147c90 con 0x7f11700a12b0 2020-07-16T20:31:10.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700645f0 con 0x7f1170137a40 2020-07-16T20:31:10.752 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1170064890 con 0x7f117013aee0 2020-07-16T20:31:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1170137a40 0x7f1170062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1170137a40 0x7f1170062d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34576/0 (socket says 172.21.15.157:34576) 2020-07-16T20:31:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 -- 172.21.15.157:0/547594128 learned_addr learned my addr 172.21.15.157:0/547594128 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f1174b5d700 1 --2- 172.21.15.157:0/547594128 >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 0x7f1170130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116f7fe700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 0x7f11701399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 -- 172.21.15.157:0/547594128 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 msgr2=0x7f11701399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 0x7f11701399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 -- 172.21.15.157:0/547594128 >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 msgr2=0x7f1170130840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 --2- 172.21.15.157:0/547594128 >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 0x7f1170130840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 -- 172.21.15.157:0/547594128 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170064b30 con 0x7f1170137a40 2020-07-16T20:31:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f1174b5d700 1 --2- 172.21.15.157:0/547594128 >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 0x7f1170130840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116f7fe700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 0x7f11701399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f116ffff700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1170137a40 0x7f1170062d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1160002f30 tx=0x7f1160015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116001d5d0 con 0x7f1170137a40 2020-07-16T20:31:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116001d730 con 0x7f1170137a40 2020-07-16T20:31:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116001da90 con 0x7f1170137a40 2020-07-16T20:31:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170064dd0 con 0x7f1170137a40 2020-07-16T20:31:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.742+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170139e90 con 0x7f1170137a40 2020-07-16T20:31:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.743+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170057490 con 0x7f1170137a40 2020-07-16T20:31:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.744+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f1160025030 con 0x7f1170137a40 2020-07-16T20:31:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.744+0000 7f114ffff700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 0x7f1148052550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.744+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f11600695f0 con 0x7f1170137a40 2020-07-16T20:31:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.744+0000 7f116f7fe700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 0x7f1148052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:10.758 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.744+0000 7f116f7fe700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 0x7f1148052550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f116400b000 tx=0x7f1164008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:10.758 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.747+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f1160041d80 con 0x7f1170137a40 2020-07-16T20:31:10.896 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.896+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f11700a1010 con 0x7f1148050090 2020-07-16T20:31:10.897 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.896+0000 7f114ffff700 1 -- 172.21.15.157:0/547594128 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f116400c030 con 0x7f1148050090 2020-07-16T20:31:10.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 msgr2=0x7f1148052550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.926 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 0x7f1148052550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f116400b000 tx=0x7f1164008040).stop 2020-07-16T20:31:10.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1170137a40 msgr2=0x7f1170062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:10.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1170137a40 0x7f1170062d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1160002f30 tx=0x7f1160015000).stop 2020-07-16T20:31:10.927 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 shutdown_connections 2020-07-16T20:31:10.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f1148050090 0x7f1148052550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> v2:172.21.15.41:3300/0 conn(0x7f11700a12b0 0x7f1170130840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1170137a40 0x7f1170062d40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 --2- 172.21.15.157:0/547594128 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f117013aee0 0x7f11701399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:10.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.897+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 >> 172.21.15.157:0/547594128 conn(0x7f1170061820 msgr2=0x7f117009e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:10.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.898+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 shutdown_connections 2020-07-16T20:31:10.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:10.898+0000 7f11765c0700 1 -- 172.21.15.157:0/547594128 wait complete. 2020-07-16T20:31:10.941 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 4 to deep-scrub 2020-07-16T20:31:10.942 INFO:tasks.ceph:Scrubbing osd.5 2020-07-16T20:31:10.943 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:11.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.054+0000 7f555035d700 1 Processor -- start 2020-07-16T20:31:11.055 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.054+0000 7f555035d700 1 -- start start 2020-07-16T20:31:11.063 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f555035d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55480a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.063 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f555035d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55480a8800 0x7f5548140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.064 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f555035d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480a4710 con 0x7f55480a7470 2020-07-16T20:31:11.064 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f555035d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55480a5c00 con 0x7f55480a8800 2020-07-16T20:31:11.064 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f555035d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480a9110 con 0x7f5548133a80 2020-07-16T20:31:11.065 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55480a8800 0x7f5548140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e0f9700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f55480a7470 0x7f5548133370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37272/0 (socket says 172.21.15.157:37272) 2020-07-16T20:31:11.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e0f9700 1 -- 172.21.15.157:0/3863913363 learned_addr learned my addr 172.21.15.157:0/3863913363 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.066 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55480a8800 0x7f5548140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34586/0 (socket says 172.21.15.157:34586) 2020-07-16T20:31:11.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554d8f8700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55480a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 -- 172.21.15.157:0/3863913363 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 msgr2=0x7f55480a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55480a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.067 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 -- 172.21.15.157:0/3863913363 >> v1:172.21.15.157:6789/0 conn(0x7f55480a7470 legacy=0x7f5548133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 -- 172.21.15.157:0/3863913363 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480a4cc0 con 0x7f55480a8800 2020-07-16T20:31:11.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554e8fa700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55480a8800 0x7f5548140be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f55380010d0 tx=0x7f55400091d0).ready entity=mon.1 client_cookie=cbdd37d6a188491b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.055+0000 7f554d0f7700 1 -- 172.21.15.157:0/3863913363 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554000b910 con 0x7f55480a8800 2020-07-16T20:31:11.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f554d0f7700 1 -- 172.21.15.157:0/3863913363 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554000ba70 con 0x7f55480a8800 2020-07-16T20:31:11.068 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f554d0f7700 1 -- 172.21.15.157:0/3863913363 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554000bbe0 con 0x7f55480a8800 2020-07-16T20:31:11.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 -- 172.21.15.157:0/3863913363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55480a8800 msgr2=0x7f5548140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.069 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55480a8800 0x7f5548140be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f55380010d0 tx=0x7f55400091d0).stop 2020-07-16T20:31:11.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 -- 172.21.15.157:0/3863913363 shutdown_connections 2020-07-16T20:31:11.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55480a8800 0x7f5548140be0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 --2- 172.21.15.157:0/3863913363 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55480a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 -- 172.21.15.157:0/3863913363 >> 172.21.15.157:0/3863913363 conn(0x7f554809e7e0 msgr2=0x7f554809ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.070 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 -- 172.21.15.157:0/3863913363 shutdown_connections 2020-07-16T20:31:11.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.056+0000 7f555035d700 1 -- 172.21.15.157:0/3863913363 wait complete. 2020-07-16T20:31:11.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.057+0000 7f555035d700 1 Processor -- start 2020-07-16T20:31:11.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.057+0000 7f555035d700 1 -- start start 2020-07-16T20:31:11.071 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f555035d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f55480a7470 0x7f554814a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f555035d700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55481290e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f555035d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480aaf00 con 0x7f5548134fe0 2020-07-16T20:31:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f555035d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554814b3c0 con 0x7f55480a7470 2020-07-16T20:31:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f555035d700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5548134bf0 con 0x7f5548133a80 2020-07-16T20:31:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e8fa700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5548134fe0 0x7f5548136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37282/0 (socket says 172.21.15.157:37282) 2020-07-16T20:31:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e8fa700 1 -- 172.21.15.157:0/2302314502 learned_addr learned my addr 172.21.15.157:0/2302314502 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e0f9700 1 --2- 172.21.15.157:0/2302314502 >> v2:172.21.15.41:3300/0 conn(0x7f55480a7470 0x7f554814a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554d8f8700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55481290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771295012 0 0) 0x7f55480aaf00 con 0x7f5548134fe0 2020-07-16T20:31:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5520003240 con 0x7f5548134fe0 2020-07-16T20:31:11.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 493179267 0 0) 0x7f5520003240 con 0x7f5548134fe0 2020-07-16T20:31:11.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55480aaf00 con 0x7f5548134fe0 2020-07-16T20:31:11.074 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f554000b910 con 0x7f5548134fe0 2020-07-16T20:31:11.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 msgr2=0x7f55481290e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f55481290e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 >> v2:172.21.15.41:3300/0 conn(0x7f55480a7470 msgr2=0x7f554814a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.075 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> v2:172.21.15.41:3300/0 conn(0x7f55480a7470 0x7f554814a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 >> v1:172.21.15.157:6789/0 conn(0x7f5548134fe0 legacy=0x7f5548136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f5520003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 0x7f55200044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55200049d0 0x7f5520004e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200042a0 con 0x7f55200049d0 2020-07-16T20:31:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552000b730 con 0x7f5520003d10 2020-07-16T20:31:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552000b870 con 0x7f5548133a80 2020-07-16T20:31:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e0f9700 1 --2- 172.21.15.157:0/2302314502 >> v2:172.21.15.41:3300/0 conn(0x7f55480a7470 0x7f554814a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554d8f8700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 0x7f55200044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e8fa700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55200049d0 0x7f5520004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.058+0000 7f554e0f9700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f5520003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 msgr2=0x7f5520003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f5548133a80 0x7f5520003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55200049d0 msgr2=0x7f5520004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55200049d0 0x7f5520004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480ab1a0 con 0x7f5520003d10 2020-07-16T20:31:11.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55480ab440 con 0x7f5520003d10 2020-07-16T20:31:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55481290e0 con 0x7f5520003d10 2020-07-16T20:31:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f554d8f8700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 0x7f55200044e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f554400c000 tx=0x7f5544008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554400ea20 con 0x7f5520003d10 2020-07-16T20:31:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400eb80 con 0x7f5520003d10 2020-07-16T20:31:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5544006020 con 0x7f5520003d10 2020-07-16T20:31:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.059+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5548135490 con 0x7f5520003d10 2020-07-16T20:31:11.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f5544006180 con 0x7f5520003d10 2020-07-16T20:31:11.086 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 0x7f552005a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f55440681d0 con 0x7f5520003d10 2020-07-16T20:31:11.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f554e0f9700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 0x7f552005a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f552005fdc0 0x7f55200621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55200628c0 con 0x7f552005fdc0 2020-07-16T20:31:11.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f554406a840 con 0x7f5520003d10 2020-07-16T20:31:11.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.060+0000 7f554e0f9700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 0x7f552005a960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5538009000 tx=0x7f5538009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.061+0000 7f554e8fa700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f552005fdc0 0x7f55200621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.061+0000 7f554e8fa700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f552005fdc0 0x7f55200621e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.090 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.062+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== osd.5 v2:172.21.15.41:6816/23951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f55200628c0 con 0x7f552005fdc0 2020-07-16T20:31:11.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.078+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 --> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f55481293c0 con 0x7f552005fdc0 2020-07-16T20:31:11.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f55367fc700 1 -- 172.21.15.157:0/2302314502 <== osd.5 v2:172.21.15.41:6816/23951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f55481293c0 con 0x7f552005fdc0 2020-07-16T20:31:11.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f552005fdc0 msgr2=0x7f55200621e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.41:6816/23951,v1:172.21.15.41:6818/23951] conn(0x7f552005fdc0 0x7f55200621e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f554e8fa700 1 -- 172.21.15.157:0/2302314502 reap_dead start 2020-07-16T20:31:11.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 msgr2=0x7f552005a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 0x7f552005a960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5538009000 tx=0x7f5538009040).stop 2020-07-16T20:31:11.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 msgr2=0x7f55200044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 0x7f55200044e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f554400c000 tx=0x7f5544008040).stop 2020-07-16T20:31:11.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 shutdown_connections 2020-07-16T20:31:11.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5520003d10 0x7f55200044e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 --2- 172.21.15.157:0/2302314502 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f55200584a0 0x7f552005a960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 >> 172.21.15.157:0/2302314502 conn(0x7f554809e7e0 msgr2=0x7f5548132850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 shutdown_connections 2020-07-16T20:31:11.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.079+0000 7f555035d700 1 -- 172.21.15.157:0/2302314502 wait complete. 2020-07-16T20:31:11.098 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:11.098 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:11.099 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:11.099 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2020-07-16T20:31:11.212 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 Processor -- start 2020-07-16T20:31:11.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 -- start start 2020-07-16T20:31:11.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 0x7f69e8132e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.213 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f69e8133300 0x7f69e8133760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80a5fc0 con 0x7f69e805b9d0 2020-07-16T20:31:11.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80a3130 con 0x7f69e80a51b0 2020-07-16T20:31:11.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.210+0000 7f69ef018700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80a5890 con 0x7f69e8133300 2020-07-16T20:31:11.214 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f69e8133300 0x7f69e8133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f69e8133300 0x7f69e8133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34610/0 (socket says 172.21.15.157:34610) 2020-07-16T20:31:11.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 -- 172.21.15.157:0/276373958 learned_addr learned my addr 172.21.15.157:0/276373958 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:11.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69e7fff700 1 --2- 172.21.15.157:0/276373958 >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 0x7f69e8132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.215 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 -- 172.21.15.157:0/276373958 >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 msgr2=0x7f69e8132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 --2- 172.21.15.157:0/276373958 >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 0x7f69e8132e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.216 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 -- 172.21.15.157:0/276373958 >> v1:172.21.15.41:6789/0 conn(0x7f69e805b9d0 legacy=0x7f69e80a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 -- 172.21.15.157:0/276373958 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80a5a80 con 0x7f69e8133300 2020-07-16T20:31:11.217 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69e7fff700 1 --2- 172.21.15.157:0/276373958 >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 0x7f69e8132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:11.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ed5b5700 1 --2- 172.21.15.157:0/276373958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e8133300 0x7f69e8133760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f69e00032b0 tx=0x7f69e0009270).ready entity=mon.1 client_cookie=8d1c3c733d1aae87 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69e77fe700 1 -- 172.21.15.157:0/276373958 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e000bc00 con 0x7f69e8133300 2020-07-16T20:31:11.218 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69e77fe700 1 -- 172.21.15.157:0/276373958 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000bd60 con 0x7f69e8133300 2020-07-16T20:31:11.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69e77fe700 1 -- 172.21.15.157:0/276373958 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e0011400 con 0x7f69e8133300 2020-07-16T20:31:11.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 -- 172.21.15.157:0/276373958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e8133300 msgr2=0x7f69e8133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.219 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 --2- 172.21.15.157:0/276373958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e8133300 0x7f69e8133760 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f69e00032b0 tx=0x7f69e0009270).stop 2020-07-16T20:31:11.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 -- 172.21.15.157:0/276373958 shutdown_connections 2020-07-16T20:31:11.220 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 --2- 172.21.15.157:0/276373958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e8133300 0x7f69e8133760 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 --2- 172.21.15.157:0/276373958 >> v2:172.21.15.41:3300/0 conn(0x7f69e80a51b0 0x7f69e8132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.221 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 -- 172.21.15.157:0/276373958 >> 172.21.15.157:0/276373958 conn(0x7f69e80abc10 msgr2=0x7f69e80ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 -- 172.21.15.157:0/276373958 shutdown_connections 2020-07-16T20:31:11.222 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.211+0000 7f69ef018700 1 -- 172.21.15.157:0/276373958 wait complete. 2020-07-16T20:31:11.233 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 Processor -- start 2020-07-16T20:31:11.235 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 -- start start 2020-07-16T20:31:11.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f69e805b9d0 0x7f69e80a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69e80a51b0 0x7f69e8139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.236 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e8139b00 con 0x7f69e8137a00 2020-07-16T20:31:11.237 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e81394f0 con 0x7f69e805b9d0 2020-07-16T20:31:11.240 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ef018700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8139790 con 0x7f69e80a51b0 2020-07-16T20:31:11.243 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ed5b5700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f69e8137a00 0x7f69e812ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37302/0 (socket says 172.21.15.157:37302) 2020-07-16T20:31:11.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.213+0000 7f69ed5b5700 1 -- 172.21.15.157:0/1627872919 learned_addr learned my addr 172.21.15.157:0/1627872919 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e7fff700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69e80a51b0 0x7f69e8139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.244 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> v2:172.21.15.41:3300/0 conn(0x7f69e805b9d0 0x7f69e80a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521470966 0 0) 0x7f69e8139b00 con 0x7f69e8137a00 2020-07-16T20:31:11.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c4003240 con 0x7f69e8137a00 2020-07-16T20:31:11.245 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1022342939 0 0) 0x7f69c4003240 con 0x7f69e8137a00 2020-07-16T20:31:11.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 --> v1:172.21.15.157:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69e8139b00 con 0x7f69e8137a00 2020-07-16T20:31:11.246 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f69e000bc00 con 0x7f69e8137a00 2020-07-16T20:31:11.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69e80a51b0 msgr2=0x7f69e8139f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69e80a51b0 0x7f69e8139f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.247 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 >> v2:172.21.15.41:3300/0 conn(0x7f69e805b9d0 msgr2=0x7f69e80a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> v2:172.21.15.41:3300/0 conn(0x7f69e805b9d0 0x7f69e80a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.248 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 >> v1:172.21.15.157:6789/0 conn(0x7f69e8137a00 legacy=0x7f69e812ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c4003800 0x7f69c4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69c40044e0 0x7f69c4004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.249 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69c4004e10 0x7f69c400b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.250 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81394f0 con 0x7f69c4004e10 2020-07-16T20:31:11.250 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8139790 con 0x7f69c4003800 2020-07-16T20:31:11.251 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4005340 con 0x7f69c40044e0 2020-07-16T20:31:11.251 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e7fff700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69e80a51b0 0x7f69e8139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:11.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> v2:172.21.15.41:3300/0 conn(0x7f69e805b9d0 0x7f69e80a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:11.252 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c4003800 0x7f69c4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ed5b5700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69c4004e10 0x7f69c400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.253 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69e7fff700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69c40044e0 0x7f69c4004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 -- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69c40044e0 msgr2=0x7f69c4004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f69c40044e0 0x7f69c4004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.254 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 -- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69c4004e10 msgr2=0x7f69c400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69c4004e10 0x7f69c400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.255 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e813a440 con 0x7f69c4003800 2020-07-16T20:31:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e812f170 con 0x7f69c4003800 2020-07-16T20:31:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ed5b5700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69c4004e10 0x7f69c400b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e812fef0 con 0x7f69c4003800 2020-07-16T20:31:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.214+0000 7f69ecdb4700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c4003800 0x7f69c4003c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f69d000d000 tx=0x7f69d0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.215+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d000dda0 con 0x7f69c4003800 2020-07-16T20:31:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.215+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d001c3f0 con 0x7f69c4003800 2020-07-16T20:31:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.215+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d001c750 con 0x7f69c4003800 2020-07-16T20:31:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8057490 con 0x7f69c4003800 2020-07-16T20:31:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f69d00133f0 con 0x7f69c4003800 2020-07-16T20:31:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69e4ff9700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69c4058710 0x7f69c405abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f69d0067b80 con 0x7f69c4003800 2020-07-16T20:31:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69e7fff700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69c4058710 0x7f69c405abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.216+0000 7f69e7fff700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69c4058710 0x7f69c405abd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f69d800c000 tx=0x7f69d8008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.219+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f69d0040230 con 0x7f69c4003800 2020-07-16T20:31:11.365 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.364+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f69e80ab9f0 con 0x7f69c4058710 2020-07-16T20:31:11.365 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.364+0000 7f69e4ff9700 1 -- 172.21.15.157:0/1627872919 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f69e80ab9f0 con 0x7f69c4058710 2020-07-16T20:31:11.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.365+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69c4058710 msgr2=0x7f69c405abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.365+0000 7f69ef018700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f69c4058710 0x7f69c405abd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f69d800c000 tx=0x7f69d8008040).stop 2020-07-16T20:31:11.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.365+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c4003800 msgr2=0x7f69c4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.365+0000 7f69ef018700 1 --2- 172.21.15.157:0/1627872919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c4003800 0x7f69c4003c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f69d000d000 tx=0x7f69d0009040).stop 2020-07-16T20:31:11.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.365+0000 7f69ed5b5700 1 -- 172.21.15.157:0/1627872919 reap_dead start 2020-07-16T20:31:11.369 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.366+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 shutdown_connections 2020-07-16T20:31:11.369 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.366+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 >> 172.21.15.157:0/1627872919 conn(0x7f69e80abc10 msgr2=0x7f69e80abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.369 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.366+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 shutdown_connections 2020-07-16T20:31:11.370 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.366+0000 7f69ef018700 1 -- 172.21.15.157:0/1627872919 wait complete. 2020-07-16T20:31:11.370 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 5 to deep-scrub 2020-07-16T20:31:11.377 INFO:tasks.ceph:Scrubbing osd.6 2020-07-16T20:31:11.377 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.487+0000 7ff973164700 1 Processor -- start 2020-07-16T20:31:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.487+0000 7ff973164700 1 -- start start 2020-07-16T20:31:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff973164700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff96c140fa0 0x7ff96c141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff973164700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 0x7ff96c1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff973164700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0a3370 con 0x7ff96c0a4f10 2020-07-16T20:31:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff973164700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0a35a0 con 0x7ff96c140fa0 2020-07-16T20:31:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff973164700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0a7530 con 0x7ff96c1462d0 2020-07-16T20:31:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff971701700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 0x7ff96c1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.491 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff96c140fa0 0x7ff96c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff96c140fa0 0x7ff96c141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.157:59864/0 (socket says 172.21.15.157:59864) 2020-07-16T20:31:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 -- 172.21.15.157:0/4056237706 learned_addr learned my addr 172.21.15.157:0/4056237706 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:11.492 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 -- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 msgr2=0x7ff96c1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 0x7ff96c1486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 -- 172.21.15.157:0/4056237706 >> v1:172.21.15.41:6789/0 conn(0x7ff96c0a4f10 legacy=0x7ff96c0a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.493 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 -- 172.21.15.157:0/4056237706 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0a61a0 con 0x7ff96c140fa0 2020-07-16T20:31:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff971701700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 0x7ff96c1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:11.494 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.488+0000 7ff970f00700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff96c140fa0 0x7ff96c141380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff960002f30 tx=0x7ff960006e90).ready entity=mon.0 client_cookie=989f04e27d79b911 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff96b7fe700 1 -- 172.21.15.157:0/4056237706 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960009850 con 0x7ff96c140fa0 2020-07-16T20:31:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff96b7fe700 1 -- 172.21.15.157:0/4056237706 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9600099b0 con 0x7ff96c140fa0 2020-07-16T20:31:11.495 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff96b7fe700 1 -- 172.21.15.157:0/4056237706 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960009d10 con 0x7ff96c140fa0 2020-07-16T20:31:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 -- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff96c140fa0 msgr2=0x7ff96c141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff96c140fa0 0x7ff96c141380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff960002f30 tx=0x7ff960006e90).stop 2020-07-16T20:31:11.496 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 -- 172.21.15.157:0/4056237706 shutdown_connections 2020-07-16T20:31:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c1462d0 0x7ff96c1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 --2- 172.21.15.157:0/4056237706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff96c140fa0 0x7ff96c141380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 -- 172.21.15.157:0/4056237706 >> 172.21.15.157:0/4056237706 conn(0x7ff96c09e7e0 msgr2=0x7ff96c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 -- 172.21.15.157:0/4056237706 shutdown_connections 2020-07-16T20:31:11.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.489+0000 7ff973164700 1 -- 172.21.15.157:0/4056237706 wait complete. 2020-07-16T20:31:11.510 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.490+0000 7ff973164700 1 Processor -- start 2020-07-16T20:31:11.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.490+0000 7ff973164700 1 -- start start 2020-07-16T20:31:11.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff973164700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 0x7ff96c142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.511 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff973164700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff96c1462d0 0x7ff96c133730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff973164700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c1362e0 con 0x7ff96c13f050 2020-07-16T20:31:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff973164700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c1423b0 con 0x7ff96c1462d0 2020-07-16T20:31:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff973164700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c142650 con 0x7ff96c0a4f10 2020-07-16T20:31:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 0x7ff96c142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff96bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff96c1462d0 0x7ff96c133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 0x7ff96c142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3301/0 says I am v2:172.21.15.157:59972/0 (socket says 172.21.15.157:59972) 2020-07-16T20:31:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 -- 172.21.15.157:0/923662615 learned_addr learned my addr 172.21.15.157:0/923662615 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff971701700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff96c13f050 0x7ff96c1356d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.157:50900/0 (socket says 172.21.15.157:50900) 2020-07-16T20:31:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 -- 172.21.15.157:0/923662615 >> v2:172.21.15.41:3300/0 conn(0x7ff96c1462d0 msgr2=0x7ff96c133730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 --2- 172.21.15.157:0/923662615 >> v2:172.21.15.41:3300/0 conn(0x7ff96c1462d0 0x7ff96c133730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 -- 172.21.15.157:0/923662615 >> v1:172.21.15.41:6789/0 conn(0x7ff96c13f050 legacy=0x7ff96c1356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff970f00700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c1428f0 con 0x7ff96c0a4f10 2020-07-16T20:31:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.491+0000 7ff96bfff700 1 --2- 172.21.15.157:0/923662615 >> v2:172.21.15.41:3300/0 conn(0x7ff96c1462d0 0x7ff96c133730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff970f00700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 0x7ff96c142d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff960002f30 tx=0x7ff960015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960009850 con 0x7ff96c0a4f10 2020-07-16T20:31:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960011e80 con 0x7ff96c0a4f10 2020-07-16T20:31:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0a2480 con 0x7ff96c0a4f10 2020-07-16T20:31:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff96001d7c0 con 0x7ff96c0a4f10 2020-07-16T20:31:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c134290 con 0x7ff96c0a4f10 2020-07-16T20:31:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.492+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff96c142230 con 0x7ff96c0a4f10 2020-07-16T20:31:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff960025030 con 0x7ff96c0a4f10 2020-07-16T20:31:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff94404ff90 0x7ff944052450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff960069440 con 0x7ff96c0a4f10 2020-07-16T20:31:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff96bfff700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff94404ff90 0x7ff944052450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7ff944057c00 0x7ff94405a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff94405a670 con 0x7ff944057c00 2020-07-16T20:31:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.493+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== mon.2 v2:172.21.15.41:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff960069750 con 0x7ff96c0a4f10 2020-07-16T20:31:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.494+0000 7ff96bfff700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff94404ff90 0x7ff944052450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff95800d000 tx=0x7ff958009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.494+0000 7ff971701700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7ff944057c00 0x7ff94405a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.519 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.494+0000 7ff971701700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7ff944057c00 0x7ff94405a020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.519 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.495+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== osd.6 v2:172.21.15.41:6808/23936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7ff94405a670 con 0x7ff944057c00 2020-07-16T20:31:11.520 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.511+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 --> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff96c057490 con 0x7ff944057c00 2020-07-16T20:31:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff968ff9700 1 -- 172.21.15.157:0/923662615 <== osd.6 v2:172.21.15.41:6808/23936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff96c057490 con 0x7ff944057c00 2020-07-16T20:31:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7ff944057c00 msgr2=0x7ff94405a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:6808/23936,v1:172.21.15.41:6809/23936] conn(0x7ff944057c00 0x7ff94405a020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff94404ff90 msgr2=0x7ff944052450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.526 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ff94404ff90 0x7ff944052450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff95800d000 tx=0x7ff958009040).stop 2020-07-16T20:31:11.526 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 msgr2=0x7ff96c142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.527 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 --2- 172.21.15.157:0/923662615 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ff96c0a4f10 0x7ff96c142d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff960002f30 tx=0x7ff960015000).stop 2020-07-16T20:31:11.527 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff971701700 1 -- 172.21.15.157:0/923662615 reap_dead start 2020-07-16T20:31:11.528 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 shutdown_connections 2020-07-16T20:31:11.528 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 >> 172.21.15.157:0/923662615 conn(0x7ff96c09e7e0 msgr2=0x7ff96c0a5390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.528 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 shutdown_connections 2020-07-16T20:31:11.529 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.512+0000 7ff973164700 1 -- 172.21.15.157:0/923662615 wait complete. 2020-07-16T20:31:11.529 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:11.529 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:11.531 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2020-07-16T20:31:11.639 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.638+0000 7f2a7d4c5700 1 Processor -- start 2020-07-16T20:31:11.640 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.638+0000 7f2a7d4c5700 1 -- start start 2020-07-16T20:31:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a7d4c5700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2a780a48e0 0x7f2a780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a7d4c5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780a5450 con 0x7f2a780a7fb0 2020-07-16T20:31:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a7d4c5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780a7880 con 0x7f2a780a8420 2020-07-16T20:31:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a7d4c5700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780ac5a0 con 0x7f2a780a48e0 2020-07-16T20:31:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a777fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2a780a8420 0x7f2a780abe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37332/0 (socket says 172.21.15.157:37332) 2020-07-16T20:31:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a777fe700 1 -- 172.21.15.157:0/3922123759 learned_addr learned my addr 172.21.15.157:0/3922123759 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/3922123759 >> v2:172.21.15.41:3300/0 conn(0x7f2a780a48e0 0x7f2a780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.639+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150066069 0 0) 0x7f2a780a7880 con 0x7f2a780a8420 2020-07-16T20:31:11.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a58003240 con 0x7f2a780a8420 2020-07-16T20:31:11.652 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4015753025 0 0) 0x7f2a58003240 con 0x7f2a780a8420 2020-07-16T20:31:11.653 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 >> v2:172.21.15.41:3300/0 conn(0x7f2a780a48e0 msgr2=0x7f2a780a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.653 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 --2- 172.21.15.157:0/3922123759 >> v2:172.21.15.41:3300/0 conn(0x7f2a780a48e0 0x7f2a780a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.653 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 >> v1:172.21.15.41:6789/0 conn(0x7f2a780a7fb0 legacy=0x7f2a780ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.654 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780a56b0 con 0x7f2a780a8420 2020-07-16T20:31:11.654 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7f2a70001a50 con 0x7f2a780a8420 2020-07-16T20:31:11.654 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 >> v1:172.21.15.157:6789/0 conn(0x7f2a780a8420 legacy=0x7f2a780abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.655 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 0x7f2a58003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.655 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a580044e0 0x7f2a58004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.655 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a58004e50 0x7f2a5800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.656 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780ac5a0 con 0x7f2a580044e0 2020-07-16T20:31:11.656 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580042c0 con 0x7f2a58003730 2020-07-16T20:31:11.657 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5800bc20 con 0x7f2a58004e50 2020-07-16T20:31:11.657 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 0x7f2a58003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.657 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a767fc700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a580044e0 0x7f2a58004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.658 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a777fe700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a58004e50 0x7f2a5800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.658 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 -- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a58004e50 msgr2=0x7f2a5800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.658 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a58004e50 0x7f2a5800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.659 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 -- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a580044e0 msgr2=0x7f2a58004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.659 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a580044e0 0x7f2a58004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.660 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 -- 172.21.15.157:0/3922123759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58003240 con 0x7f2a58003730 2020-07-16T20:31:11.660 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a777fe700 1 -- 172.21.15.157:0/3922123759 reap_dead start 2020-07-16T20:31:11.660 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a767fc700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a580044e0 0x7f2a58004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:11.661 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 0x7f2a58003b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2a6000c000 tx=0x7f2a60008040).ready entity=mon.1 client_cookie=f63482a98a0e502d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.661 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6000e970 con 0x7f2a58003730 2020-07-16T20:31:11.661 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000ead0 con 0x7f2a58003730 2020-07-16T20:31:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a75ffb700 1 -- 172.21.15.157:0/3922123759 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6000ee30 con 0x7f2a58003730 2020-07-16T20:31:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 msgr2=0x7f2a58003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.640+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 0x7f2a58003b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2a6000c000 tx=0x7f2a60008040).stop 2020-07-16T20:31:11.663 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.641+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/3922123759 shutdown_connections 2020-07-16T20:31:11.663 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.641+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/3922123759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a58003730 0x7f2a58003b10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.664 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.641+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/3922123759 >> 172.21.15.157:0/3922123759 conn(0x7f2a78061820 msgr2=0x7f2a7809e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.664 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.641+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/3922123759 shutdown_connections 2020-07-16T20:31:11.664 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.641+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/3922123759 wait complete. 2020-07-16T20:31:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.642+0000 7f2a7d4c5700 1 Processor -- start 2020-07-16T20:31:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.642+0000 7f2a7d4c5700 1 -- start start 2020-07-16T20:31:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a780a12e0 0x7f2a7812c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a7812cac0 0x7f2a7814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78137470 con 0x7f2a78137ae0 2020-07-16T20:31:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780a1770 con 0x7f2a780a12e0 2020-07-16T20:31:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780a0050 con 0x7f2a7812cac0 2020-07-16T20:31:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a780a12e0 0x7f2a7812c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a780a12e0 0x7f2a7812c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34656/0 (socket says 172.21.15.157:34656) 2020-07-16T20:31:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a76ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2a78137ae0 0x7f2a78144a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37342/0 (socket says 172.21.15.157:37342) 2020-07-16T20:31:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 -- 172.21.15.157:0/2735700949 learned_addr learned my addr 172.21.15.157:0/2735700949 (peer_addr_for_me v2:172.21.15.157:0/0) 2020-07-16T20:31:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a777fe700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a7812cac0 0x7f2a7814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 -- 172.21.15.157:0/2735700949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a7812cac0 msgr2=0x7f2a7814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a7812cac0 0x7f2a7814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 -- 172.21.15.157:0/2735700949 >> v1:172.21.15.157:6789/0 conn(0x7f2a78137ae0 legacy=0x7f2a78144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191068376 0 0) 0x7f2a78137470 con 0x7f2a78137ae0 2020-07-16T20:31:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 -- 172.21.15.157:0/2735700949 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7809fe20 con 0x7f2a780a12e0 2020-07-16T20:31:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a767fc700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a780a12e0 0x7f2a7812c5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2a6800b000 tx=0x7f2a68009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a68010710 con 0x7f2a780a12e0 2020-07-16T20:31:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68010870 con 0x7f2a780a12e0 2020-07-16T20:31:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a780a02f0 con 0x7f2a780a12e0 2020-07-16T20:31:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.643+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a68010bd0 con 0x7f2a780a12e0 2020-07-16T20:31:11.673 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.644+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a78136c40 con 0x7f2a780a12e0 2020-07-16T20:31:11.673 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.644+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a780a0480 con 0x7f2a780a12e0 2020-07-16T20:31:11.674 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.645+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2a68014430 con 0x7f2a780a12e0 2020-07-16T20:31:11.674 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.645+0000 7f2a6effd700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 0x7f2a540523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.675 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.645+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2a680681c0 con 0x7f2a780a12e0 2020-07-16T20:31:11.675 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.645+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 0x7f2a540523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.675 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.645+0000 7f2a76ffd700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 0x7f2a540523b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2a60006a60 tx=0x7f2a6001a000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.648+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f2a68040870 con 0x7f2a780a12e0 2020-07-16T20:31:11.796 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.795+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a78057490 con 0x7f2a5404fef0 2020-07-16T20:31:11.797 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.795+0000 7f2a6effd700 1 -- 172.21.15.157:0/2735700949 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a78057490 con 0x7f2a5404fef0 2020-07-16T20:31:11.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 msgr2=0x7f2a540523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.799 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 0x7f2a540523b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2a60006a60 tx=0x7f2a6001a000).stop 2020-07-16T20:31:11.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a780a12e0 msgr2=0x7f2a7812c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a780a12e0 0x7f2a7812c5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2a6800b000 tx=0x7f2a68009040).stop 2020-07-16T20:31:11.800 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 shutdown_connections 2020-07-16T20:31:11.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f2a5404fef0 0x7f2a540523b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f2a7812cac0 0x7f2a7814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.801 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 --2- 172.21.15.157:0/2735700949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a780a12e0 0x7f2a7812c5d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 >> 172.21.15.157:0/2735700949 conn(0x7f2a78061820 msgr2=0x7f2a7812edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 shutdown_connections 2020-07-16T20:31:11.802 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.797+0000 7f2a7d4c5700 1 -- 172.21.15.157:0/2735700949 wait complete. 2020-07-16T20:31:11.803 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 6 to deep-scrub 2020-07-16T20:31:11.808 INFO:tasks.ceph:Scrubbing osd.7 2020-07-16T20:31:11.808 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:31:11.920 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.919+0000 7ffae1733700 1 Processor -- start 2020-07-16T20:31:11.920 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.919+0000 7ffae1733700 1 -- start start 2020-07-16T20:31:11.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffae1733700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffadc0a7470 0x7ffadc133370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.928 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffae1733700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffadc140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffae1733700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc133cc0 con 0x7ffadc133860 2020-07-16T20:31:11.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffae1733700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0a4710 con 0x7ffadc0a7470 2020-07-16T20:31:11.929 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffae1733700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0a5c00 con 0x7ffadc0a8a20 2020-07-16T20:31:11.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffad3fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ffadc133860 0x7ffadc0a8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37350/0 (socket says 172.21.15.157:37350) 2020-07-16T20:31:11.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffad3fff700 1 -- 172.21.15.157:0/196994381 learned_addr learned my addr 172.21.15.157:0/196994381 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915832922 0 0) 0x7ffac40010d0 con 0x7ffadc133860 2020-07-16T20:31:11.930 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffabc003240 con 0x7ffadc133860 2020-07-16T20:31:11.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffadb7fe700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffadc140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> v2:172.21.15.41:3300/0 conn(0x7ffadc0a7470 0x7ffadc133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2612589384 0 0) 0x7ffabc003240 con 0x7ffadc133860 2020-07-16T20:31:11.931 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 msgr2=0x7ffadc140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffadc140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 >> v2:172.21.15.41:3300/0 conn(0x7ffadc0a7470 msgr2=0x7ffadc133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 --2- 172.21.15.157:0/196994381 >> v2:172.21.15.41:3300/0 conn(0x7ffadc0a7470 0x7ffadc133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0a9110 con 0x7ffadc133860 2020-07-16T20:31:11.932 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3480979573 0 0) 0x7ffac4001860 con 0x7ffadc133860 2020-07-16T20:31:11.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.920+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> v2:172.21.15.41:3300/0 conn(0x7ffadc0a7470 0x7ffadc133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:11.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 >> v1:172.21.15.157:6789/0 conn(0x7ffadc133860 legacy=0x7ffadc0a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.933 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffabc003730 0x7ffabc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.934 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffabc0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.934 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffabc0049d0 0x7ffabc004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.934 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0a4710 con 0x7ffabc0049d0 2020-07-16T20:31:11.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0a5c00 con 0x7ffabc003730 2020-07-16T20:31:11.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc004220 con 0x7ffadc0a8a20 2020-07-16T20:31:11.935 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffabc003730 0x7ffabc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffad3fff700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffabc0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadb7fe700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffabc0049d0 0x7ffabc004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.936 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 -- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 msgr2=0x7ffabc0044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7ffadc0a8a20 0x7ffabc0044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.937 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 -- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffabc0049d0 msgr2=0x7ffabc004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffabc0049d0 0x7ffabc004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 -- 172.21.15.157:0/196994381 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc003240 con 0x7ffabc003730 2020-07-16T20:31:11.938 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadaffd700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffabc003730 0x7ffabc003b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ffacc00a000 tx=0x7ffacc008040).ready entity=mon.1 client_cookie=cc94144fe9363176 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffacc00db30 con 0x7ffabc003730 2020-07-16T20:31:11.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc00dc90 con 0x7ffabc003730 2020-07-16T20:31:11.939 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffada7fc700 1 -- 172.21.15.157:0/196994381 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffacc012420 con 0x7ffabc003730 2020-07-16T20:31:11.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 -- 172.21.15.157:0/196994381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffabc003730 msgr2=0x7ffabc003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 --2- 172.21.15.157:0/196994381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffabc003730 0x7ffabc003b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ffacc00a000 tx=0x7ffacc008040).stop 2020-07-16T20:31:11.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffadb7fe700 1 -- 172.21.15.157:0/196994381 reap_dead start 2020-07-16T20:31:11.940 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 -- 172.21.15.157:0/196994381 shutdown_connections 2020-07-16T20:31:11.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 -- 172.21.15.157:0/196994381 >> 172.21.15.157:0/196994381 conn(0x7ffadc09e7e0 msgr2=0x7ffadc09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 -- 172.21.15.157:0/196994381 shutdown_connections 2020-07-16T20:31:11.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.921+0000 7ffae1733700 1 -- 172.21.15.157:0/196994381 wait complete. 2020-07-16T20:31:11.941 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 Processor -- start 2020-07-16T20:31:11.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 -- start start 2020-07-16T20:31:11.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffadc0aac50 0x7ffadc1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc146ce0 con 0x7ffadc0a07b0 2020-07-16T20:31:11.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc146f70 con 0x7ffadc12dc30 2020-07-16T20:31:11.942 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffae1733700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0aa0a0 con 0x7ffadc0aac50 2020-07-16T20:31:11.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffad3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffadc0aac50 0x7ffadc1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffadaffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ffadc12dc30 0x7ffadc0aa540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37364/0 (socket says 172.21.15.157:37364) 2020-07-16T20:31:11.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffad3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffadc0aac50 0x7ffadc1467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34674/0 (socket says 172.21.15.157:34674) 2020-07-16T20:31:11.943 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.923+0000 7ffadaffd700 1 -- 172.21.15.157:0/2084156103 learned_addr learned my addr 172.21.15.157:0/2084156103 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:11.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad3fff700 1 -- 172.21.15.157:0/2084156103 >> v1:172.21.15.157:6789/0 conn(0x7ffadc12dc30 legacy=0x7ffadc0aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad3fff700 1 -- 172.21.15.157:0/2084156103 >> v1:172.21.15.41:6789/0 conn(0x7ffadc0a07b0 legacy=0x7ffadc0a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244948653 0 0) 0x7ffadc146f70 con 0x7ffadc12dc30 2020-07-16T20:31:11.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad3fff700 1 -- 172.21.15.157:0/2084156103 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc12e010 con 0x7ffadc0aac50 2020-07-16T20:31:11.944 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad3fff700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffadc0aac50 0x7ffadc1467f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ffac400b000 tx=0x7ffac4001640).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.945 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac400ea60 con 0x7ffadc0aac50 2020-07-16T20:31:11.945 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400ebc0 con 0x7ffadc0aac50 2020-07-16T20:31:11.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0a1350 con 0x7ffadc0aac50 2020-07-16T20:31:11.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac4014430 con 0x7ffadc0aac50 2020-07-16T20:31:11.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.924+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc151bf0 con 0x7ffadc0aac50 2020-07-16T20:31:11.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffadc0a3720 con 0x7ffadc0aac50 2020-07-16T20:31:11.947 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ffac4014630 con 0x7ffadc0aac50 2020-07-16T20:31:11.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ffab804fe50 0x7ffab8052310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ffac4067d40 con 0x7ffadc0aac50 2020-07-16T20:31:11.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffadaffd700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ffab804fe50 0x7ffab8052310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.948 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7ffab8057940 0x7ffab8059d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.949 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 --> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffab805a3b0 con 0x7ffab8057940 2020-07-16T20:31:11.949 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.925+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac406a3b0 con 0x7ffadc0aac50 2020-07-16T20:31:11.949 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.926+0000 7ffadaffd700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ffab804fe50 0x7ffab8052310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ffacc002f30 tx=0x7ffacc008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.949 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.926+0000 7ffadb7fe700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7ffab8057940 0x7ffab8059d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.950 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.926+0000 7ffadb7fe700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7ffab8057940 0x7ffab8059d60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.950 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.927+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== osd.7 v2:172.21.15.41:6817/23952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7ffab805a3b0 con 0x7ffab8057940 2020-07-16T20:31:11.951 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.943+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 --> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffadc133cc0 con 0x7ffab8057940 2020-07-16T20:31:11.952 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffad2ffd700 1 -- 172.21.15.157:0/2084156103 <== osd.7 v2:172.21.15.41:6817/23952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffadc133cc0 con 0x7ffab8057940 2020-07-16T20:31:11.952 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7ffab8057940 msgr2=0x7ffab8059d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.952 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.41:6817/23952,v1:172.21.15.41:6819/23952] conn(0x7ffab8057940 0x7ffab8059d60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.953 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ffab804fe50 msgr2=0x7ffab8052310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.953 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7ffab804fe50 0x7ffab8052310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ffacc002f30 tx=0x7ffacc008040).stop 2020-07-16T20:31:11.953 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffadc0aac50 msgr2=0x7ffadc1467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffadc0aac50 0x7ffadc1467f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ffac400b000 tx=0x7ffac4001640).stop 2020-07-16T20:31:11.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffadb7fe700 1 -- 172.21.15.157:0/2084156103 reap_dead start 2020-07-16T20:31:11.954 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 shutdown_connections 2020-07-16T20:31:11.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 --2- 172.21.15.157:0/2084156103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffadc0aac50 0x7ffadc1467f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 >> 172.21.15.157:0/2084156103 conn(0x7ffadc09e7e0 msgr2=0x7ffadc132eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.955 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 shutdown_connections 2020-07-16T20:31:11.956 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:11.944+0000 7ffae1733700 1 -- 172.21.15.157:0/2084156103 wait complete. 2020-07-16T20:31:11.956 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2020-07-16T20:31:11.957 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:31:11.957 INFO:teuthology.orchestra.run.smithi157.stdout:} 2020-07-16T20:31:11.961 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2020-07-16T20:31:12.076 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.068+0000 7f6d00806700 1 Processor -- start 2020-07-16T20:31:12.077 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.068+0000 7f6d00806700 1 -- start start 2020-07-16T20:31:12.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6d00806700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6cfc0a48e0 0x7f6cfc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.079 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6d00806700 1 --2- >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 0x7f6cfc0a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6d00806700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0a5450 con 0x7f6cfc0ab780 2020-07-16T20:31:12.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6d00806700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0a7880 con 0x7f6cfc0a48e0 2020-07-16T20:31:12.080 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6d00806700 1 -- --> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0a8930 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfad9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6cfc0ab780 0x7f6cfc0abbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37374/0 (socket says 172.21.15.157:37374) 2020-07-16T20:31:12.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfad9d700 1 -- 172.21.15.157:0/2081888054 learned_addr learned my addr 172.21.15.157:0/2081888054 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:12.081 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 --2- 172.21.15.157:0/2081888054 >> v2:172.21.15.41:3300/0 conn(0x7f6cfc0a48e0 0x7f6cfc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf9d9b700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 0x7f6cfc0a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269148792 0 0) 0x7f6cfc0a5450 con 0x7f6cfc0ab780 2020-07-16T20:31:12.082 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc003240 con 0x7f6cfc0ab780 2020-07-16T20:31:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 msgr2=0x7f6cfc0a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 0x7f6cfc0a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3438569720 0 0) 0x7f6cdc003240 con 0x7f6cfc0ab780 2020-07-16T20:31:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2081888054 >> v1:172.21.15.157:6789/0 conn(0x7f6cfc0ab780 legacy=0x7f6cfc0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2081888054 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0a56b0 con 0x7f6cfc0a48e0 2020-07-16T20:31:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf9d9b700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 0x7f6cfc0a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:31:12.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cfa59c700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6cfc0a48e0 0x7f6cfc0a4cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f6cec001870 tx=0x7f6cf40091d0).ready entity=mon.0 client_cookie=539c4fae27f66ea8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.085 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.069+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cec0016d0 con 0x7f6cfc0a48e0 2020-07-16T20:31:12.087 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400b800 con 0x7f6cfc0a48e0 2020-07-16T20:31:12.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6cf959a700 1 -- 172.21.15.157:0/2081888054 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cf400b970 con 0x7f6cfc0a48e0 2020-07-16T20:31:12.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 -- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6cfc0a48e0 msgr2=0x7f6cfc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6cfc0a48e0 0x7f6cfc0a4cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f6cec001870 tx=0x7f6cf40091d0).stop 2020-07-16T20:31:12.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 -- 172.21.15.157:0/2081888054 shutdown_connections 2020-07-16T20:31:12.088 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6cfc0a48e0 0x7f6cfc0a4cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 --2- 172.21.15.157:0/2081888054 >> [v2:172.21.15.41:3301/0,v1:172.21.15.41:6790/0] conn(0x7f6cfc0a7fb0 0x7f6cfc0a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 -- 172.21.15.157:0/2081888054 >> 172.21.15.157:0/2081888054 conn(0x7f6cfc061820 msgr2=0x7f6cfc09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:12.089 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 -- 172.21.15.157:0/2081888054 shutdown_connections 2020-07-16T20:31:12.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.070+0000 7f6d00806700 1 -- 172.21.15.157:0/2081888054 wait complete. 2020-07-16T20:31:12.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.071+0000 7f6d00806700 1 Processor -- start 2020-07-16T20:31:12.092 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.071+0000 7f6d00806700 1 -- start start 2020-07-16T20:31:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6cfc0a7fb0 0x7f6cfc127b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6cfc139e00 0x7f6cfc13a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc128500 con 0x7f6cfc0ab780 2020-07-16T20:31:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc129670 con 0x7f6cfc139e00 2020-07-16T20:31:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc135a60 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6cfc0a7fb0 0x7f6cfc127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf9d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6cfc0ab780 0x7f6cfc148fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37380/0 (socket says 172.21.15.157:37380) 2020-07-16T20:31:12.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf9d9b700 1 -- 172.21.15.157:0/2707134028 learned_addr learned my addr 172.21.15.157:0/2707134028 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:12.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfad9d700 1 --2- 172.21.15.157:0/2707134028 >> v2:172.21.15.41:3300/0 conn(0x7f6cfc139e00 0x7f6cfc13a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2707134028 >> v2:172.21.15.41:3300/0 conn(0x7f6cfc139e00 msgr2=0x7f6cfc13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.095 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 --2- 172.21.15.157:0/2707134028 >> v2:172.21.15.41:3300/0 conn(0x7f6cfc139e00 0x7f6cfc13a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629580607 0 0) 0x7f6cfc128500 con 0x7f6cfc0ab780 2020-07-16T20:31:12.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2707134028 >> v1:172.21.15.157:6789/0 conn(0x7f6cfc0ab780 legacy=0x7f6cfc148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 -- 172.21.15.157:0/2707134028 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc1289f0 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.096 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cfa59c700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cfc0a7fb0 0x7f6cfc127b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f6cec001870 tx=0x7f6cf4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cf4020400 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4020560 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc128730 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cf40208c0 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.097 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.072+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc138910 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.073+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc138630 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.073+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6cf401e070 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.074+0000 7f6cf27fc700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 0x7f6cd8052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.098 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.074+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6cf4068800 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.099 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.074+0000 7f6cf9d9b700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 0x7f6cd8052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.099 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.074+0000 7f6cf9d9b700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 0x7f6cd8052240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6ce4002f30 tx=0x7f6ce4006dd0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.100 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.077+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6cf4040fc0 con 0x7f6cfc0a7fb0 2020-07-16T20:31:12.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.223+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cfc057490 con 0x7f6cd804fd80 2020-07-16T20:31:12.225 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.224+0000 7f6cf27fc700 1 -- 172.21.15.157:0/2707134028 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6cfc057490 con 0x7f6cd804fd80 2020-07-16T20:31:12.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 msgr2=0x7f6cd8052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.227 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 0x7f6cd8052240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6ce4002f30 tx=0x7f6ce4006dd0).stop 2020-07-16T20:31:12.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cfc0a7fb0 msgr2=0x7f6cfc127b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cfc0a7fb0 0x7f6cfc127b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f6cec001870 tx=0x7f6cf4016000).stop 2020-07-16T20:31:12.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 shutdown_connections 2020-07-16T20:31:12.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f6cd804fd80 0x7f6cd8052240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.228 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 --2- 172.21.15.157:0/2707134028 >> v2:172.21.15.41:3300/0 conn(0x7f6cfc139e00 0x7f6cfc13a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.229 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 --2- 172.21.15.157:0/2707134028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cfc0a7fb0 0x7f6cfc127b70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 >> 172.21.15.157:0/2707134028 conn(0x7f6cfc061820 msgr2=0x7f6cfc1413b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:12.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 shutdown_connections 2020-07-16T20:31:12.230 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.225+0000 7f6d00806700 1 -- 172.21.15.157:0/2707134028 wait complete. 2020-07-16T20:31:12.234 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 7 to deep-scrub 2020-07-16T20:31:12.237 INFO:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:31:12.353 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 Processor -- start 2020-07-16T20:31:12.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 -- start start 2020-07-16T20:31:12.354 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bbc0a4cc0 0x7f0bbc133390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.356 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0a5450 con 0x7f0bbc0a48e0 2020-07-16T20:31:12.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0a7880 con 0x7f0bbc0a86c0 2020-07-16T20:31:12.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.343+0000 7f0bc47ac700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0a56b0 con 0x7f0bbc0a4cc0 2020-07-16T20:31:12.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc2d49700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bbc0a4cc0 0x7f0bbc133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.357 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1d47700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0bbc0a86c0 0x7f0bbc132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37388/0 (socket says 172.21.15.157:37388) 2020-07-16T20:31:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1d47700 1 -- 172.21.15.157:0/1909511880 learned_addr learned my addr 172.21.15.157:0/1909511880 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1909511880 >> v1:172.21.15.157:6789/0 conn(0x7f0bbc0a86c0 legacy=0x7f0bbc132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1546700 1 -- 172.21.15.157:0/1909511880 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121036817 0 0) 0x7f0bbc0a7880 con 0x7f0bbc0a86c0 2020-07-16T20:31:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1909511880 >> v1:172.21.15.41:6789/0 conn(0x7f0bbc0a48e0 legacy=0x7f0bbc0a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1909511880 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0a5950 con 0x7f0bbc0a4cc0 2020-07-16T20:31:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc2d49700 1 --2- 172.21.15.157:0/1909511880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a4cc0 0x7f0bbc133390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0bb8002f30 tx=0x7f0bb8006dd0).ready entity=mon.1 client_cookie=a94bb683ae4ac75b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1546700 1 -- 172.21.15.157:0/1909511880 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb80097f0 con 0x7f0bbc0a4cc0 2020-07-16T20:31:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1546700 1 -- 172.21.15.157:0/1909511880 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8009950 con 0x7f0bbc0a4cc0 2020-07-16T20:31:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc1546700 1 -- 172.21.15.157:0/1909511880 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb8009cb0 con 0x7f0bbc0a4cc0 2020-07-16T20:31:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1909511880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a4cc0 msgr2=0x7f0bbc133390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1909511880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a4cc0 0x7f0bbc133390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0bb8002f30 tx=0x7f0bb8006dd0).stop 2020-07-16T20:31:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1909511880 shutdown_connections 2020-07-16T20:31:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1909511880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a4cc0 0x7f0bbc133390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1909511880 >> 172.21.15.157:0/1909511880 conn(0x7f0bbc061820 msgr2=0x7f0bbc09e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:12.361 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1909511880 shutdown_connections 2020-07-16T20:31:12.361 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.344+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1909511880 wait complete. 2020-07-16T20:31:12.361 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 Processor -- start 2020-07-16T20:31:12.361 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 -- start start 2020-07-16T20:31:12.362 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 0x7f0bbc13a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.363 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bbc0a2320 0x7f0bbc0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.363 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0a09b0 con 0x7f0bbc0a86c0 2020-07-16T20:31:12.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc09f3c0 con 0x7f0bbc0a48e0 2020-07-16T20:31:12.366 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc47ac700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc09f660 con 0x7f0bbc0a2320 2020-07-16T20:31:12.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc2d49700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bbc0a2320 0x7f0bbc0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.367 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc1d47700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0bbc0a86c0 0x7f0bbc0a02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:37392/0 (socket says 172.21.15.157:37392) 2020-07-16T20:31:12.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc1d47700 1 -- 172.21.15.157:0/1687160253 learned_addr learned my addr 172.21.15.157:0/1687160253 (peer_addr_for_me v1:172.21.15.157:0/0) 2020-07-16T20:31:12.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.346+0000 7f0bc2548700 1 --2- 172.21.15.157:0/1687160253 >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 0x7f0bbc13a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1687160253 >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 msgr2=0x7f0bbc13a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.368 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2d49700 1 --2- 172.21.15.157:0/1687160253 >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 0x7f0bbc13a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.369 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1687160253 >> v1:172.21.15.157:6789/0 conn(0x7f0bbc0a86c0 legacy=0x7f0bbc0a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.370 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2d49700 1 -- 172.21.15.157:0/1687160253 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc09f900 con 0x7f0bbc0a2320 2020-07-16T20:31:12.370 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286987360 0 0) 0x7f0bbc0a09b0 con 0x7f0bbc0a86c0 2020-07-16T20:31:12.370 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2548700 1 --2- 172.21.15.157:0/1687160253 >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 0x7f0bbc13a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:31:12.370 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc2d49700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a2320 0x7f0bbc0abbb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0bb8002f30 tx=0x7f0bb8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.371 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb801d5d0 con 0x7f0bbc0a2320 2020-07-16T20:31:12.371 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb801d730 con 0x7f0bbc0a2320 2020-07-16T20:31:12.371 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc09fba0 con 0x7f0bbc0a2320 2020-07-16T20:31:12.371 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb801da90 con 0x7f0bbc0a2320 2020-07-16T20:31:12.372 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.347+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc147800 con 0x7f0bbc0a2320 2020-07-16T20:31:12.372 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.348+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc0a30e0 con 0x7f0bbc0a2320 2020-07-16T20:31:12.372 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.348+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0bb8025030 con 0x7f0bbc0a2320 2020-07-16T20:31:12.373 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.348+0000 7f0bae7fc700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 0x7f0b94052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:12.373 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.348+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0bb80694e0 con 0x7f0bbc0a2320 2020-07-16T20:31:12.373 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.348+0000 7f0bc2548700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 0x7f0b94052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:12.373 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.349+0000 7f0bc2548700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 0x7f0b94052320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0bb400b000 tx=0x7f0bb4009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:12.374 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.352+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f0bb8041c70 con 0x7f0bbc0a2320 2020-07-16T20:31:12.502 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.493+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 --> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bbc0a0000 con 0x7f0b9404fe60 2020-07-16T20:31:12.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.496+0000 7f0bae7fc700 1 -- 172.21.15.157:0/1687160253 <== mgr.4108 v2:172.21.15.157:6800/23153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82339 (secure 0 0 0) 0x7f0bb40133c0 con 0x7f0b9404fe60 2020-07-16T20:31:12.503 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 msgr2=0x7f0b94052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 0x7f0b94052320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0bb400b000 tx=0x7f0bb4009040).stop 2020-07-16T20:31:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a2320 msgr2=0x7f0bbc0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:12.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a2320 0x7f0bbc0abbb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0bb8002f30 tx=0x7f0bb8015000).stop 2020-07-16T20:31:12.507 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 shutdown_connections 2020-07-16T20:31:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:6800/23153,v1:172.21.15.157:6801/23153] conn(0x7f0b9404fe60 0x7f0b94052320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1687160253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0a2320 0x7f0bbc0abbb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 --2- 172.21.15.157:0/1687160253 >> v2:172.21.15.41:3300/0 conn(0x7f0bbc0a48e0 0x7f0bbc13a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:12.514 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 >> 172.21.15.157:0/1687160253 conn(0x7f0bbc061820 msgr2=0x7f0bbc05f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:12.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 shutdown_connections 2020-07-16T20:31:12.515 INFO:teuthology.orchestra.run.smithi157.stderr:2020-07-16T20:31:12.498+0000 7f0bc47ac700 1 -- 172.21.15.157:0/1687160253 wait complete. 2020-07-16T20:31:12.515 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2020-07-16T20:31:12.516 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-07-16T20:31:12.521 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2020-07-16T20:31:10.552732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":833064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002291"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934353+0000","last_change":"2020-07-16T20:30:50.929263+0000","last_active":"2020-07-16T20:30:50.934353+0000","last_peered":"2020-07-16T20:30:50.934353+0000","last_clean":"2020-07-16T20:30:50.934353+0000","last_became_active":"2020-07-16T20:30:50.928273+0000","last_became_peered":"2020-07-16T20:30:50.928273+0000","last_unstale":"2020-07-16T20:30:50.934353+0000","last_undegraded":"2020-07-16T20:30:50.934353+0000","last_fullsized":"2020-07-16T20:30:50.934353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.733535+0000","last_change":"2020-07-16T20:30:44.962204+0000","last_active":"2020-07-16T20:30:50.733535+0000","last_peered":"2020-07-16T20:30:50.733535+0000","last_clean":"2020-07-16T20:30:50.733535+0000","last_became_active":"2020-07-16T20:30:44.961763+0000","last_became_peered":"2020-07-16T20:30:44.961763+0000","last_unstale":"2020-07-16T20:30:50.733535+0000","last_undegraded":"2020-07-16T20:30:50.733535+0000","last_fullsized":"2020-07-16T20:30:50.733535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.758603+0000","last_change":"2020-07-16T20:30:47.717995+0000","last_active":"2020-07-16T20:30:53.758603+0000","last_peered":"2020-07-16T20:30:53.758603+0000","last_clean":"2020-07-16T20:30:53.758603+0000","last_became_active":"2020-07-16T20:30:47.717450+0000","last_became_peered":"2020-07-16T20:30:47.717450+0000","last_unstale":"2020-07-16T20:30:53.758603+0000","last_undegraded":"2020-07-16T20:30:53.758603+0000","last_fullsized":"2020-07-16T20:30:53.758603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934773+0000","last_change":"2020-07-16T20:30:50.930286+0000","last_active":"2020-07-16T20:30:50.934773+0000","last_peered":"2020-07-16T20:30:50.934773+0000","last_clean":"2020-07-16T20:30:50.934773+0000","last_became_active":"2020-07-16T20:30:50.929602+0000","last_became_peered":"2020-07-16T20:30:50.929602+0000","last_unstale":"2020-07-16T20:30:50.934773+0000","last_undegraded":"2020-07-16T20:30:50.934773+0000","last_fullsized":"2020-07-16T20:30:50.934773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735167+0000","last_change":"2020-07-16T20:30:44.962272+0000","last_active":"2020-07-16T20:30:50.735167+0000","last_peered":"2020-07-16T20:30:50.735167+0000","last_clean":"2020-07-16T20:30:50.735167+0000","last_became_active":"2020-07-16T20:30:44.961928+0000","last_became_peered":"2020-07-16T20:30:44.961928+0000","last_unstale":"2020-07-16T20:30:50.735167+0000","last_undegraded":"2020-07-16T20:30:50.735167+0000","last_fullsized":"2020-07-16T20:30:50.735167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.752563+0000","last_change":"2020-07-16T20:30:47.713854+0000","last_active":"2020-07-16T20:30:53.752563+0000","last_peered":"2020-07-16T20:30:53.752563+0000","last_clean":"2020-07-16T20:30:53.752563+0000","last_became_active":"2020-07-16T20:30:47.713550+0000","last_became_peered":"2020-07-16T20:30:47.713550+0000","last_unstale":"2020-07-16T20:30:53.752563+0000","last_undegraded":"2020-07-16T20:30:53.752563+0000","last_fullsized":"2020-07-16T20:30:53.752563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934332+0000","last_change":"2020-07-16T20:30:50.929119+0000","last_active":"2020-07-16T20:30:50.934332+0000","last_peered":"2020-07-16T20:30:50.934332+0000","last_clean":"2020-07-16T20:30:50.934332+0000","last_became_active":"2020-07-16T20:30:50.928367+0000","last_became_peered":"2020-07-16T20:30:50.928367+0000","last_unstale":"2020-07-16T20:30:50.934332+0000","last_undegraded":"2020-07-16T20:30:50.934332+0000","last_fullsized":"2020-07-16T20:30:50.934332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.926306+0000","last_change":"2020-07-16T20:30:44.693534+0000","last_active":"2020-07-16T20:30:50.926306+0000","last_peered":"2020-07-16T20:30:50.926306+0000","last_clean":"2020-07-16T20:30:50.926306+0000","last_became_active":"2020-07-16T20:30:44.693060+0000","last_became_peered":"2020-07-16T20:30:44.693060+0000","last_unstale":"2020-07-16T20:30:50.926306+0000","last_undegraded":"2020-07-16T20:30:50.926306+0000","last_fullsized":"2020-07-16T20:30:50.926306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761618+0000","last_change":"2020-07-16T20:30:47.969735+0000","last_active":"2020-07-16T20:30:53.761618+0000","last_peered":"2020-07-16T20:30:53.761618+0000","last_clean":"2020-07-16T20:30:53.761618+0000","last_became_active":"2020-07-16T20:30:47.969397+0000","last_became_peered":"2020-07-16T20:30:47.969397+0000","last_unstale":"2020-07-16T20:30:53.761618+0000","last_undegraded":"2020-07-16T20:30:53.761618+0000","last_fullsized":"2020-07-16T20:30:53.761618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.928282+0000","last_change":"2020-07-16T20:30:50.927407+0000","last_active":"2020-07-16T20:30:50.928282+0000","last_peered":"2020-07-16T20:30:50.928282+0000","last_clean":"2020-07-16T20:30:50.928282+0000","last_became_active":"2020-07-16T20:30:50.926714+0000","last_became_peered":"2020-07-16T20:30:50.926714+0000","last_unstale":"2020-07-16T20:30:50.928282+0000","last_undegraded":"2020-07-16T20:30:50.928282+0000","last_fullsized":"2020-07-16T20:30:50.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735228+0000","last_change":"2020-07-16T20:30:44.879472+0000","last_active":"2020-07-16T20:30:50.735228+0000","last_peered":"2020-07-16T20:30:50.735228+0000","last_clean":"2020-07-16T20:30:50.735228+0000","last_became_active":"2020-07-16T20:30:44.879044+0000","last_became_peered":"2020-07-16T20:30:44.879044+0000","last_unstale":"2020-07-16T20:30:50.735228+0000","last_undegraded":"2020-07-16T20:30:50.735228+0000","last_fullsized":"2020-07-16T20:30:50.735228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.811130+0000","last_change":"2020-07-16T20:30:39.886285+0000","last_active":"2020-07-16T20:30:50.811130+0000","last_peered":"2020-07-16T20:30:50.811130+0000","last_clean":"2020-07-16T20:30:50.811130+0000","last_became_active":"2020-07-16T20:30:39.885893+0000","last_became_peered":"2020-07-16T20:30:39.885893+0000","last_unstale":"2020-07-16T20:30:50.811130+0000","last_undegraded":"2020-07-16T20:30:50.811130+0000","last_fullsized":"2020-07-16T20:30:50.811130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:32.595429+0000","last_clean_scrub_stamp":"2020-07-16T20:30:32.595429+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:51.531044+0000","last_change":"2020-07-16T20:30:47.717861+0000","last_active":"2020-07-16T20:30:51.531044+0000","last_peered":"2020-07-16T20:30:51.531044+0000","last_clean":"2020-07-16T20:30:51.531044+0000","last_became_active":"2020-07-16T20:30:47.717403+0000","last_became_peered":"2020-07-16T20:30:47.717403+0000","last_unstale":"2020-07-16T20:30:51.531044+0000","last_undegraded":"2020-07-16T20:30:51.531044+0000","last_fullsized":"2020-07-16T20:30:51.531044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.930822+0000","last_change":"2020-07-16T20:30:50.928755+0000","last_active":"2020-07-16T20:30:50.930822+0000","last_peered":"2020-07-16T20:30:50.930822+0000","last_clean":"2020-07-16T20:30:50.930822+0000","last_became_active":"2020-07-16T20:30:50.928124+0000","last_became_peered":"2020-07-16T20:30:50.928124+0000","last_unstale":"2020-07-16T20:30:50.930822+0000","last_undegraded":"2020-07-16T20:30:50.930822+0000","last_fullsized":"2020-07-16T20:30:50.930822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735124+0000","last_change":"2020-07-16T20:30:44.695156+0000","last_active":"2020-07-16T20:30:50.735124+0000","last_peered":"2020-07-16T20:30:50.735124+0000","last_clean":"2020-07-16T20:30:50.735124+0000","last_became_active":"2020-07-16T20:30:44.694873+0000","last_became_peered":"2020-07-16T20:30:44.694873+0000","last_unstale":"2020-07-16T20:30:50.735124+0000","last_undegraded":"2020-07-16T20:30:50.735124+0000","last_fullsized":"2020-07-16T20:30:50.735124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734862+0000","last_change":"2020-07-16T20:30:47.716604+0000","last_active":"2020-07-16T20:30:50.734862+0000","last_peered":"2020-07-16T20:30:50.734862+0000","last_clean":"2020-07-16T20:30:50.734862+0000","last_became_active":"2020-07-16T20:30:47.716172+0000","last_became_peered":"2020-07-16T20:30:47.716172+0000","last_unstale":"2020-07-16T20:30:50.734862+0000","last_undegraded":"2020-07-16T20:30:50.734862+0000","last_fullsized":"2020-07-16T20:30:50.734862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.934749+0000","last_change":"2020-07-16T20:30:50.929889+0000","last_active":"2020-07-16T20:30:50.934749+0000","last_peered":"2020-07-16T20:30:50.934749+0000","last_clean":"2020-07-16T20:30:50.934749+0000","last_became_active":"2020-07-16T20:30:50.929189+0000","last_became_peered":"2020-07-16T20:30:50.929189+0000","last_unstale":"2020-07-16T20:30:50.934749+0000","last_undegraded":"2020-07-16T20:30:50.934749+0000","last_fullsized":"2020-07-16T20:30:50.934749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735992+0000","last_change":"2020-07-16T20:30:44.695179+0000","last_active":"2020-07-16T20:30:50.735992+0000","last_peered":"2020-07-16T20:30:50.735992+0000","last_clean":"2020-07-16T20:30:50.735992+0000","last_became_active":"2020-07-16T20:30:44.694857+0000","last_became_peered":"2020-07-16T20:30:44.694857+0000","last_unstale":"2020-07-16T20:30:50.735992+0000","last_undegraded":"2020-07-16T20:30:50.735992+0000","last_fullsized":"2020-07-16T20:30:50.735992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.761507+0000","last_change":"2020-07-16T20:30:47.719857+0000","last_active":"2020-07-16T20:30:53.761507+0000","last_peered":"2020-07-16T20:30:53.761507+0000","last_clean":"2020-07-16T20:30:53.761507+0000","last_became_active":"2020-07-16T20:30:47.719440+0000","last_became_peered":"2020-07-16T20:30:47.719440+0000","last_unstale":"2020-07-16T20:30:53.761507+0000","last_undegraded":"2020-07-16T20:30:53.761507+0000","last_fullsized":"2020-07-16T20:30:53.761507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.816507+0000","last_change":"2020-07-16T20:30:50.813452+0000","last_active":"2020-07-16T20:30:50.816507+0000","last_peered":"2020-07-16T20:30:50.816507+0000","last_clean":"2020-07-16T20:30:50.816507+0000","last_became_active":"2020-07-16T20:30:50.812786+0000","last_became_peered":"2020-07-16T20:30:50.812786+0000","last_unstale":"2020-07-16T20:30:50.816507+0000","last_undegraded":"2020-07-16T20:30:50.816507+0000","last_fullsized":"2020-07-16T20:30:50.816507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.759108+0000","last_change":"2020-07-16T20:30:47.718207+0000","last_active":"2020-07-16T20:30:53.759108+0000","last_peered":"2020-07-16T20:30:53.759108+0000","last_clean":"2020-07-16T20:30:53.759108+0000","last_became_active":"2020-07-16T20:30:47.717750+0000","last_became_peered":"2020-07-16T20:30:47.717750+0000","last_unstale":"2020-07-16T20:30:53.759108+0000","last_undegraded":"2020-07-16T20:30:53.759108+0000","last_fullsized":"2020-07-16T20:30:53.759108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.734870+0000","last_change":"2020-07-16T20:30:44.728373+0000","last_active":"2020-07-16T20:30:50.734870+0000","last_peered":"2020-07-16T20:30:50.734870+0000","last_clean":"2020-07-16T20:30:50.734870+0000","last_became_active":"2020-07-16T20:30:44.727914+0000","last_became_peered":"2020-07-16T20:30:44.727914+0000","last_unstale":"2020-07-16T20:30:50.734870+0000","last_undegraded":"2020-07-16T20:30:50.734870+0000","last_fullsized":"2020-07-16T20:30:50.734870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.814909+0000","last_change":"2020-07-16T20:30:50.814285+0000","last_active":"2020-07-16T20:30:50.814909+0000","last_peered":"2020-07-16T20:30:50.814909+0000","last_clean":"2020-07-16T20:30:50.814909+0000","last_became_active":"2020-07-16T20:30:50.812831+0000","last_became_peered":"2020-07-16T20:30:50.812831+0000","last_unstale":"2020-07-16T20:30:50.814909+0000","last_undegraded":"2020-07-16T20:30:50.814909+0000","last_fullsized":"2020-07-16T20:30:50.814909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.717231+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.717231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-07-16T20:30:50.735926+0000","last_change":"2020-07-16T20:30:44.727996+0000","last_active":"2020-07-16T20:30:50.735926+0000","last_peered":"2020-07-16T20:30:50.735926+0000","last_clean":"2020-07-16T20:30:50.735926+0000","last_became_active":"2020-07-16T20:30:44.727593+0000","last_became_peered":"2020-07-16T20:30:44.727593+0000","last_unstale":"2020-07-16T20:30:50.735926+0000","last_undegraded":"2020-07-16T20:30:50.735926+0000","last_fullsized":"2020-07-16T20:30:50.735926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:43.678062+0000","last_clean_scrub_stamp":"2020-07-16T20:30:43.678062+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:53.756760+0000","last_change":"2020-07-16T20:30:47.969976+0000","last_active":"2020-07-16T20:30:53.756760+0000","last_peered":"2020-07-16T20:30:53.756760+0000","last_clean":"2020-07-16T20:30:53.756760+0000","last_became_active":"2020-07-16T20:30:47.969384+0000","last_became_peered":"2020-07-16T20:30:47.969384+0000","last_unstale":"2020-07-16T20:30:53.756760+0000","last_undegraded":"2020-07-16T20:30:53.756760+0000","last_fullsized":"2020-07-16T20:30:53.756760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:46.696774+0000","last_clean_scrub_stamp":"2020-07-16T20:30:46.696774+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.607}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":105092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]}]}} 2020-07-16T20:31:12.543 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.543 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.544 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.544 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.544 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.545 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.545 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.546 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.546 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.548 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.548 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.549 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-07-16T20:30:32.595429+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.549 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.550 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.550 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.551 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.551 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.551 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.552 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.552 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.552 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.553 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.553 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-07-16T20:30:49.717231+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=49, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.554 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-07-16T20:30:43.678062+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=43, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.554 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-07-16T20:30:46.696774+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=31, tm_sec=7, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:12.555 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-07-16T20:31:19.923 INFO:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:31:19.928 INFO:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:31:23.834 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-07-16T20:31:23.835 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2020-07-16T20:31:23.837 DEBUG:teuthology.task.console_log:Killing console logger for smithi041 2020-07-16T20:31:23.838 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2020-07-16T20:31:23.838 DEBUG:teuthology.task.console_log:Killing console logger for smithi041 2020-07-16T20:31:23.839 DEBUG:teuthology.exit:Finished running handlers